We invite you to participate in the first shared task of the SIGIR 2024 Workshop on Reaching Efficiency in Neural Information Retrieval (ReNeuIR). The workshop aims to foster discussion and collaboration on the holistic evaluation of methods in the age of neural information retrieval (NIR), noting that effectiveness matters, but so does the computational cost incurred to achieve it.
Shared Task Overview Our shared task aims to develop a more comprehensive understanding of the efficiency-vs-effectiveness landscape with the goal of promoting better metrics and deeper investigation into this area. It is based on the MS MARCO (version one) passage collection and focuses on batch processing an entire log of queries. We invite the community to submit either a source repository or a docker image of their approaches for cloud-based evaluation, and we provide detailed instructions/tutorials to assist with this process. Please see the website for more information: https://reneuir.org/shared_task.html
-------------------------------------------------------------------------------
Important Dates
------------------------------------------------------------------------------- June 26, 2024: Shared task oral presentation deadline
July 18, 2024: Workshop (co-located with SIGIR 2024 in Washington)
July 31, 2024: Final Proceedings Deadline (yes, after the conference)
-------------------------------------------------------------------------------
Questions? Please contact us! reneuir2024@easychair.org
Best regards,
ReNeuIR team