Conference: GEM at ACL 2026, special Comic-Con edition! Date: July 3nd or July 4rd, 2026 Location: San Diego, California, USA Website: https://gem-workshop.com/ *Submission deadline: *March 19th (via Open Review https://openreview.net/group?id=aclweb.org/ACL/2026/Workshop/GEM#tab-your-consoles ) Contact: gem-workshop-chairs@googlegroups.com

Evaluation of language models has grown to be a central theme in NLP research, while remaining far from solved. As LMs have become more powerful, errors have become tougher to spot and systems harder to distinguish. Evaluation practices are evolving rapidly—from living benchmarks like Chatbot Arena to LMs being used as evaluators themselves (e.g., LM as judge, autoraters). Further research is needed to understand the interplay between metrics, benchmarks, and human-in-the-loop evaluation, and their impact in real-world settings. We will welcome submissions on a variety of topics and encourage themed presentations and posters! See Website https://gem-workshop.com/ for more information.

*Submissions* through Open Review https://openreview.net/group?id=aclweb.org/ACL/2026/Workshop/GEM#tab-your-consoles can take any of the following forms:

- Archival Papers: Original and unpublished work, for all the following tracks—Main, ReproNLP, and Opinion/Statement. - *Non-Archival Extended Abstracts*: Work already presented or under review at a peer-reviewed venue. This is an excellent opportunity to share recent or ongoing work with the GEM community without precluding future publication. - *Findings Papers*: We additionally welcome presentation of relevant papers accepted to Findings, and will share more information at a later date.

*Important Dates*

- March 19, 2026: Direct paper submission deadline - April 9, 2026: Pre-reviewed ARR commitment deadline - April 28, 2026: Notification of acceptance - May 14, 2026: Camera-ready paper due - June 4, 2026: Pre-recorded video due (hard deadline) - July 3–4, 2026: Workshop at ACL in San Diego

We hope to see you there!

*Dublin City University* *Simon Mille *| Postdoctoral Research Fellow ADAPT Centre School of Computing Dublin City University Dublin 9 Ireland www.adaptcentre.ie

*ADAPT Taighde Éireann – Research Ireland Centre for Digital Content Technology* Privileged/confidential information: This e-mail and any files transmitted with it are confidential and are intended solely for use by the addressee. Please note that electronic mail to, from or within the College, may be the subject of a request under the Freedom of Information Act. https://adaptcentre.us8.list-manage.com/subscribe?u=1bed8296322695727ba35177c&id=5658135e5d