--------------------- Challenge Links:
Challenge Homepage: https://brandonio-c.github.io/ClinIQLink-2025/
Challenge Sample Dataset: https://github.com/Brandonio-c/ClinIQLink_Sample-dataset
CodaBench ClinIQLink Docker Setup (GitHub): https://github.com/Brandonio-c/ClinIQLink_CodaBench_docker-setup
--------------------- Challenge Links:
ClinIQLink @ BIONLP @ ACL 2025 - Important updates!
We are pleased to share a set of important updates regarding the ClinIQLink Challenge, focused on evaluating factuality in clinical question answering:
1. Extended Submission Deadline The system submission deadline has been extended to 05 May 2025 at 23:59 AOE (Anywhere on Earth). This allows additional time for teams to finalize and submit their models.
2. Rolling Evaluation Process Submissions are being evaluated on a first-come, first-served basis. We encourage early submission to receive results in a timely manner.
3. Baseline Benchmark Release We will release performance benchmarks this Friday from a selection of open-source large language models evaluated on the ClinIQLink dataset. These results will serve as reference points for participating teams.
4. Updated Submission Instructions Submission guidelines have been clarified to support reproducibility and containerized evaluation. The revised instructions are available at: https://github.com/Brandonio-c/ClinIQLink_CodaBench_docker-setup/blob/main/s...
5. Large Model Submissions Still Accepted Teams submitting large models (e.g., models between 10GB and 750GB) may request access.
For full challenge details, please visit the challenge homepage: https://cliniqlink.org/
If you have any questions, feel free to reach out to me at brandon.colelough@nih.govmailto:brandon.colelough@nih.gov.
We look forward to your participation.
Best regards, Brandon Colelough brandon.colelough@nih.govmailto:brandon.colelough@nih.gov