December 2025 - Corpora

Deadline extended: AfricaNLP @ EACL 2026
by Constantine Lignos 17 Dec '25

17 Dec '25

Deadline Extension and Final Call for Papers: 7th AfricaNLP Workshop @ EACL 2026 (Rabat, Morocco) Theme: Multilingual Multimodal LLMs Website: https://sites.google.com/view/africanlp2026/home Submission URL: https://openreview.net/group?id=eacl.org/EACL/2026/Workshop/AfricaNLP The AfricaNLP workshop at EACL 2026 invites papers related to any aspect of NLP for African languages. In the current landscape, large language models (LLMs) have seen widespread use and significant innovation, yet African languages remain underrepresented. To address this disparity, the theme for the 2026 workshop is Multilingual Multimodal LLMs. We believe this is an especially timely theme as LLMs are becoming more multilingually capable, but their performance across other modalities such as images and speech continues to lag behind. This workshop invites research and discussion on how multilingual and multimodal systems can better reflect the diversity of African languages and communities. Key Dates (all deadlines Anywhere on Earth time zone) - Direct Submission: December 22nd, 2025 (extended) - ARR Submission: January 9th, 2026 - Acceptance Notification: January 23, 2026 - Workshop: day-long event during EACL 2026 (March 24-29, 2026) Submission Formats - Full Papers: 4–8 pages (archival or non-archival) - Extended Abstracts: up to 2 pages (non-archival) - ARR Submissions: Papers from the October 2025 ARR cycle (or earlier) with completed reviews and metareview AfricaNLP aspires to bring together a diverse group of researchers to explore solutions, collaborations, and innovation around enhancing LLMs’ capabilities in African languages and ensuring cultural awareness in their applications. We particularly welcome first-time authors, collaborative efforts, and work connecting multiple modalities — text, speech, or vision — for the benefit of African communities. *Contact: *africanlp-eacl2026(a)googlegroups.com Constantine Lignos Assistant Professor of Computational Linguistics Pronouns: he/him/his

1 0

Call for Participation: HealTAC 2026
by Jaya Chaturvedi 17 Dec '25

17 Dec '25

-------------------------------------------- HealTAC 2026 June 8-10th, 2026, Brighton (UK) https://healtac2026.github.io/ -------------------------------------------- The 9th Healthcare Text Analytics Conference (HealTAC 2026) invites contributions that address any aspect of healthcare text analytics. This year’s theme is Human-Centered AI & NLP: Bridging Research and Real-World Practice ---------------------------- Call for Contribution ---------------------------- We invite submissions in the form of extended abstracts (up to 2 pages) describing methodological or application-focused work that has not been previously presented at a conference. Submissions should be prepared based on a template that is available at the conference web site. This year, we will focus on Human-Centered AI & NLP: Bridging Research and Real-World Practice, so we encourage submissions in that space in particular. We also invite submissions describing ongoing PhD research (at any stage) or planned fellowship applications. The conference will provide an opportunity to receive constructive feedback from a panel of experts. In addition, we invite submissions for software demonstrations, and new for 2026, we are also welcoming proposals for panel discussions. See the website (Call for Contribution<https://healtac2026.github.io/cfp/>) for full details. --------------------------- Key dates ---------------------------- Submissions open: January 9, 2026 Deadline for all contributions: February 27, 2026 Notification of acceptance: April 17, 2026 Early-bird registration deadline: May 4, 2026 Pre-conference workshop: June 8, 2026 Conference: June 9-10, 2026 As in previous years, there will be a post-conference call to submit a journal length paper for further peer review and publication in Frontiers in Digital Health. ---------------------------- Registration fees ---------------------------- Due to generous support from our sponsors, we will keep the registration fee low as before: An early registration fee for students is expected to be £100 and for others £200. All registrations include the full 3-day programme and lunches. Conference dinner (optional) will be separate. Students with accepted papers will be able to register for free. More details on registration can be found here<https://healtac2026.github.io/registration/>. Travel and accommodation details are also available here<https://healtac2026.github.io/accommodation/>. Follow the conference announcements on social media at #HEALTAC2026 We are looking forward to welcoming you to HealTAC 2026 in Brighton! Jaya Chaturvedi BDS MSc PhD Research Associate in Health Related Natural Language Processing Department of Biostatistics and Health Informatics C3.15, Social Genetic and Developmental Psychiatry Centre Institute of Psychiatry, Psychology & Neuroscience King’s College London PO Box 80, De Crespigny Park London SE5 8AF Pronunciation: Jah-yah Pronouns: she/her GitHub: https://github.com/jayachaturvedi Bluesky: @Jayachatur.bsky.social LinkedIn: https://www.linkedin.com/in/jayachaturvedi/ [cid:image001.png@01DAF499.ADF8D370] If you receive an email from me outside of normal working hours, please do not feel the need to respond outside of your own working hours.

1 0

CfP: AraSentEval Shared Task - OSACT7 within LREC 2026
by Saad Ezzini 17 Dec '25

17 Dec '25

Call for Participation: AraSentEval 2026 Shared Task Subject: Call for Participation: AraSentEval 2026 Shared Task on Sentiment Analysis and Swapping in Arabic (Hosted with OSACT7 at LREC 2026) We are delighted to invite you to participate in the AraSentEval 2026 Shared Task, hosted in conjunction with the 7th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT7) at LREC 2026. Overview Sentiment analysis remains a critical application in NLP, yet Arabic presents unique challenges due to its rich morphology and dialectal variations. AraSentEval 2026 aims to push the boundaries of Arabic sentiment analysis by evaluating both understanding (classification) and generation (style transfer) in diverse contexts. Task Description AraSentEval features two complementary subtasks designed to foster innovation in Arabic NLP: Subtask 1: Arabic Dialect Sentiment Analysis A multi-class classification task to identify the sentiment (positive, negative, or neutral) of texts written in various Arabic dialects (Moroccan, Egyptian, Jordanian, and Saudi). This subtask focuses on robustness across lexical and syntactic diversity. Subtask 2: Arabic Sentiment Swap A challenging generative task where systems must rewrite an Arabic sentence to invert its sentiment polarity (e.g., positive to negative) while preserving its core meaning. This task requires deep semantic understanding and high-quality generation capabilities. Datasets * Subtask 1: Multi-Dialect-Sent (MDS-3), a balanced dataset of 3,000 sentences across five major dialects. * Subtask 2: MAAKS, a manually-curated parallel dataset of 5,000 Modern Standard Arabic sentence pairs. Important Dates (Tentative) * January 01, 2026: Release of training/dev data and evaluation scripts. * February 10, 2026: Registration deadline and release of test data. * February 17, 2026: End of evaluation cycle (Test set submission closes). * February 24, 2026: Announcement of results. * March 10, 2026: System description paper submissions due. * March 20, 2026: Notification of acceptance. * March 30, 2026: Camera-ready versions due. * May 2026 (TBC): Workshop at LREC 2026. Participation Participants are welcome to submit to one or both subtasks. The shared task will be managed via CodaLab. For more details, participation guidelines, and data access, please visit our task website: https://ezzini.github.io/AraSentEval/ Organizers * Saad Ezzini, King Fahd University of Petroleum and Minerals, KSA * Paul Rayson, Lancaster University, UK * Shadi Abudalfa, King Fahd University of Petroleum and Minerals, KSA * Maram Alharbi, Lancaster University, UK * Mo El-Haj, VinUniversity, Vietnam / Lancaster University, UK * Samaher Alghamdi, Lancaster University, UK * Reem Alotaibi, King Abdulaziz University, KSA * Salmane Chafik, UM6P, Morocco We look forward to your participation! Best regards, The AraSentEval 2026 Organizers ********************************************************************** DISCLAIMER: The information in this email and its attachments (if any) is intended for the addressee only and may contain confidential or privileged information. If you are not the intended recipient, please delete the email and its attachments from your system and notify the sender immediately. You should not retain, disclose, copy, or use this email or any of its contents for any purpose, nor disclose its contents to any other person. KFUPM is not responsible for changes made to this message after it was sent. Statements and opinions expressed in this e-mail are those of the sender, and do not necessarily reflect those of KFUPM. KFUPM is not liable for any effect or virus damage caused by this message. إن المعلومات الواردة في هذا البريد الإلكتروني ومرفقاته إن وجدت، قد تكون خاصة أو سرية؛ فإذا لم تكن المقصود بهذه الرسالة؛ فيُرجى منك حذفها ومرفقاتها من نظامك وإخطار المرسل بخطأ وصولها إليك فورا. كما لا يجوز نسخ أي جزء منها أو مرفقاتها ، أو الإفصاح عن محتوياتها لأي شخص أو استعمالها لأي غرض آخر. إن جامعة الملك فهد للبترول والمعادن لا تتحمل مسؤولية التغييرات التي يتم إجراؤها على هذه الرسالة بعد إرسالها. وإن البيانات أو الآراء المعبر عنها في هذا البريد، هي بيانات تخص مُرسلها، ولا تعكس بالضرورة رأي وبيانات الجامعة. كما لا تتحمل الجامعة مسؤولية أي تأثير ينتج عن هذه الرسالة أوعن أي فيروس قد تحمله.

1 0

1st CFP: 19th Workshop on Building and Using Comparable Corpora (BUCC) at LREC 2026
by Reinhard Rapp 16 Dec '25

16 Dec '25

Call for Papers ************************************************************** 19th WORKSHOP ON BUILDING AND USING COMPARABLE CORPORA Co-located with LREC 2026, Palma de Mallorca (in-person & online) May 11, 2026 Paper submission deadline: February 28, 2026 Workshop website: https://comparable.lisn.upsaclay.fr/bucc2026/ Main conference website: https://lrec2026.info/ ************************************************************** MOTIVATION In the language engineering and linguistics communities, research in comparable corpora has been motivated by two main reasons. In language engineering, on the one hand, it is chiefly motivated by the need to use comparable corpora as training data for data-driven NLP applications such as statistical and neural machine translation, or cross-lingual retrieval. In linguistics, on the other hand, comparable corpora are of interest because they enable cross-language discoveries and comparisons. It is generally accepted in both communities that comparable corpora consist of documents that are comparable in content and form in various degrees and dimensions across several languages. Parallel corpora are on the one end of this spectrum, and unrelated corpora are on the other. Increasingly, these resources are not only collected, but also augmented or even created synthetically, which raises new questions about how to define and measure comparability. In recent years, the use of comparable corpora for pre-training Large Language Models (LLMs) has led to their impressive multilingual and cross-lingual abilities, which are relevant to a range of applications, including information retrieval, machine translation, cross-lingual text classification, etc. The linguistic definitions and observations related to comparable corpora are crucial to improve methods to mine such corpora, to assess and document synthetic data, and to improve cross-lingual transfer of LLMs. Therefore, it is of great interest to bring together builders and users of such corpora. PANEL DISCUSSION The panel discusses the impact of synthetic data on comparable corpora research. Fundamental questions about how LLMs transform our understanding and use of multilingual data are addressed. TOPICS We solicit contributions on all topics related to comparable (and parallel) corpora, including but not limited to the following: Building Comparable Corpora - Automatic and semi-automatic methods, including generating comparable corpora using LLMs - Methods to mine parallel and non-parallel corpora from the web - Tools and criteria to evaluate the comparability of corpora - Parallel vs non-parallel corpora, monolingual corpora - Rare and minority languages, within and across language families - Multi-media/multi-modal comparable corpora Synthetic Data for Comparable Corpora - LLM generation of comparable/parallel data - Improving comparability of synthetic data - Incidental bilingualism & pre-training use of comparable data - Comparability & cross-lingual consistency - Detection & attribution of synthetic vs. human text - English-centric effects & fairness across languages/scripts - Evaluation & reproducibility for downstream tasks Applications of Comparable Corpora - Human translation - Language learning - Cross-language information retrieval & document categorization - Bilingual and multilingual projections - (Unsupervised) machine translation - Writing assistance - Machine learning techniques using comparable corpora Mining from Comparable Corpora - Cross-language distributional semantics, word embeddings and pre-trained multilingual transformer models - Extraction of parallel segments or paraphrases from comparable corpora - Methods to derive parallel from non-parallel corpora (e.g. to provide for low-resource languages in neural machine translation) - Extraction of bilingual and multilingual translations of single words, multi-word expressions, proper names, named entities, sentences, paraphrases etc. from comparable corpora. - Induction of morphological, grammatical, and translation rules from comparable corpora - Induction of multilingual word classes from comparable corpora Comparable Corpora in the Humanities - Comparing linguistic phenomena across languages in contrastive linguistics - Analyzing properties of translated language in translation studies - Studying language change over time in diachronic linguistics - Assigning texts to authors via authors' corpora in forensic linguistics - Comparing rhetorical features in discourse analysis - Studying cultural differences in sociolinguistics - Analyzing language universals in typological research IMPORTANT DATES 28 Feb 2026: Paper Submission deadline 22 Mar 2026: Notification of acceptance 29 Mar 2026: Camera-ready final papers 14 Apr 2026: Workshop Programme final version 11 May 2026: Workshop date All deadlines are 11:59PM UTC-12:00 (“anywhere on earth”). For updates of the schedule, please see the workshop website. PRACTICAL INFORMATION The workshop is a hybrid event, both in-person and online. Workshop registration is via the main conference registration site, see https://lrec2026.info/ The workshop proceedings will be published in the ACL Anthology (https://aclanthology.org/). SUBMISSION GUIDELINES Please follow the style sheet and templates (for LaTeX, Overleaf and MS-Word) provided for the main conference at https://lrec2026.info/authors-kit/ Papers should be submitted as a PDF file using the START conference manager at https://softconf.com/lrec2026/BUCC2026/ Submissions must describe original and unpublished work and range from 4 to 8 pages plus unlimited references. Reviewing will be double blind, so the papers should not reveal the authors' identity. Accepted papers will be published in the workshop proceedings. Double submission policy: Parallel submission to other meetings or publications is possible but must be notified to the workshop organizers by e-mail immediately upon submission to another venue. For further information and updates, please see the BUCC 2026 web page at https://comparable.lisn.upsaclay.fr/bucc2026/. WORKSHOP ORGANIZERS - Reinhard Rapp (University of Mainz, Germany) - Ayla Rigouts Terryn (Université de Montréal, Mila, Canada) - Serge Sharoff (University of Leeds, United Kingdom) - Pierre Zweigenbaum (Université Paris-Saclay, CNRS, France) Contact: reinhardrapp (at) gmx (dot) de PROGRAMME COMMITTEE - Ebrahim Ansari (Institute for Advanced Studies in Basic Sciences, Iran) - Eleftherios Avramidis (DFKI, Germany) - Gabriel Bernier-Colborne (National Research Council, Canada) - Kenneth Church (VecML.com, USA) - Patrick Drouin (Université de Montréal, Canada) - Alex Fraser (Technical University of Munich, Germany) - Natalia Grabar (CNRS, University of Lille, France) - Amal Haddad Haddad (Universidad de Granada, Spain) - Kyo Kageura (University of Tokyo, Japan) - Natalie Kübler (Université Paris Cité, France) - Philippe Langlais (Université de Montréal, Canada) - Yves Lepage (Waseda University, Japan) - Shervin Malmasi (Amazon, USA) - Michael Mohler (Language Computer Corporation, USA) - Emmanuel Morin (Nantes Université, France) - Dragos Stefan Munteanu (RWS, USA) - Preslav Nakov (Mohamed bin Zayed University of AI, United Arab Emirates) - Ted Pedersen (University of Minnesota, Duluth, USA) - Reinhard Rapp (University of Mainz, Germany) - Ayla Rigouts Terryn (Université de Montréal & Mila, Canada) - Nasredine Semmar (CEA LIST, Paris, France) - Serge Sharoff (University of Leeds, UK) - Richard Sproat (Sakana.ai, Tokyo, Japan) - Marko Tadić (University of Zagreb, Croatia) - François Yvon (CNRS & Sorbonne Université, France) - Pierre Zweigenbaum (Université Paris-Saclay, CNRS, France) INFORMATION ABOUT THE LRE 2026 MAP AND THE "SHARE YOUR LRs!" INITIATIVE When submitting a paper from the START page, authors will be asked to provide essential information about resources (in a broad sense, i.e. also technologies, standards, evaluation kits, etc.) that have been used for the work described in the paper or are a new result of the research. Moreover, ELRA encourages all LREC authors to share the described LRs (data, tools, services, etc.) to enable their reuse and replicability of experiments (including evaluation ones).

1 0

CfP: NakbaVirality Shared Task - NakbaNLP within LREC 2026
by Saad Ezzini 16 Dec '25

16 Dec '25

Call for Participation: NakbaVirality Shared Task Multimodal and Textual Virality Prediction in High-Stakes Discourse Organized within the second Nakba-NLP Workshop at LREC 2026 https://lrec2026.info/ 11-16 May 2026 Palma de Mallorca, Spain We invite you to participate in the NakbaVirality Shared Task, a new challenge focusing on predicting the reach and engagement of content surrounding the Nakba and the post-October 7th war on Gaza. This task operates at the intersection of NLP, Computer Vision, and Computational Social Science, aiming to understand information diffusion in highly polarized and emotionally charged contexts. Website: https://ezzini.github.io/NakbaVirality/ Registration: https://forms.gle/ufj2gqRyMrrdDs5f9 Motivation Understanding what makes a post "go viral" in conflict zones is critical for analyzing propaganda spread, public sentiment, and information maneuvering. This shared task challenges participants to model "virality" not just as a number, but as a function of nuanced text, graphic imagery, and deep historical context. Tasks We propose two distinct tasks: Task 1: Multimodal Virality Classification * Goal: Classify posts into Low, Medium, or High virality buckets. * Input: Text + Image. * Challenge: Aligning mismatched modalities (e.g., peaceful image vs. violent interaction) and handling "dog whistles." * Metric: Macro-F1 Score. Task 2: Textual Virality and Interaction Prediction (Regression) * Goal: Predict distinct Likability (agreement) and Interactivity (controversy/engagement) scores. * Input: Text only. * Challenge: Distinguishing between content that is "liked" versus content that provokes "debate." * Metrics: Pearson Correlation (r) and MSE. Data * Sources: X (Twitter) and Reddit. * Size: ~5,000 anonymized samples (post-Oct 2023). * Content: Posts related to "Gaza," "Nakba," "Palestine," "Israel," etc. Important Dates * Jan 1: Release of Training Data (3,500 samples) * Feb 1: Release of Development Data (500 samples) * Feb 15: Evaluation Period Begins * Feb 20: Evaluation Period Ends * Mar 1: Paper Submission Deadline Participation & Submission * Participation is free. * Teams must verify their results by submitting a system description paper (max 4 pages). * Papers will be published in the proceedings (ACLAnthology). * Detailed guidelines: https://ezzini.github.io/NakbaVirality/guidelines Organizers * Saad Ezzini, King Fahd University of Petroleum and Minerals * Salima Lamsiyah, University of Luxembourg * Shadi Abudalfa, King Fahd University of Petroleum & Minerals * Samir El-Amrany, University of Luxembourg * Walid Alsafadi, University College of Applied Sciences Gaza For more information, please visit our website https://ezzini.github.io/NakbaVirality/ or contact us at saad.ezzini(a)kfupm.edu.sa<mailto:saad.ezzini@kfupm.edu.sa> ********************************************************************** DISCLAIMER: The information in this email and its attachments (if any) is intended for the addressee only and may contain confidential or privileged information. If you are not the intended recipient, please delete the email and its attachments from your system and notify the sender immediately. You should not retain, disclose, copy, or use this email or any of its contents for any purpose, nor disclose its contents to any other person. KFUPM is not responsible for changes made to this message after it was sent. Statements and opinions expressed in this e-mail are those of the sender, and do not necessarily reflect those of KFUPM. KFUPM is not liable for any effect or virus damage caused by this message. إن المعلومات الواردة في هذا البريد الإلكتروني ومرفقاته إن وجدت، قد تكون خاصة أو سرية؛ فإذا لم تكن المقصود بهذه الرسالة؛ فيُرجى منك حذفها ومرفقاتها من نظامك وإخطار المرسل بخطأ وصولها إليك فورا. كما لا يجوز نسخ أي جزء منها أو مرفقاتها ، أو الإفصاح عن محتوياتها لأي شخص أو استعمالها لأي غرض آخر. إن جامعة الملك فهد للبترول والمعادن لا تتحمل مسؤولية التغييرات التي يتم إجراؤها على هذه الرسالة بعد إرسالها. وإن البيانات أو الآراء المعبر عنها في هذا البريد، هي بيانات تخص مُرسلها، ولا تعكس بالضرورة رأي وبيانات الجامعة. كما لا تتحمل الجامعة مسؤولية أي تأثير ينتج عن هذه الرسالة أوعن أي فيروس قد تحمله.

1 0

[CfP] Knowledge Graphs and Large Language Models (KG–LLM 2026) @ LREC 2026
by Gilles Sérasset 16 Dec '25

16 Dec '25

Knowledge Graphs and Large Language Models (KG–LLM 2026) @ LREC 2026 We are pleased to announce the Workshop on Knowledge Graphs and Large Language Models (KG–LLM 2026), to be held in conjunction with LREC 2026 in Palma de Mallorca, Spain, May 16th 2026. We invite submissions of original research that leverages both Knowledge Graphs (KGs) and Large Language Models (LLMs) in any domain of Natural Language Processing or language resource development. More information at https://kg-llm.github.io/ Workshop Overview Large Language Models have become foundational in NLP, yet they continue to face challenges related to bias, hallucination, explainability, environmental impact, and the cost of training. Knowledge Graphs, in contrast, provide high-quality, interpretable, and reusable ontological and linguistic structures that support reasoning, fact checking, and knowledge preservation. The goal of this workshop is to bring together researchers working at the intersection of these two paradigms, exploring how explicit knowledge and implicit statistical learning can enhance each other. We welcome contributions that investigate, demonstrate, or evaluate systems, methods, or resources integrating both KGs and LLMs. Topics of Interest We encourage submissions on (but not limited to): 1. LLMs for Knowledge Graph Engineering KG modelling, resource creation, and interlinking Relation extraction Corpus annotation Ontology localization Creation or expansion of linguistic or knowledge graphs KG querying and question answering 2. Knowledge Graphs for Large Language Models Using linguistic or knowledge graphs as training data Fine-tuning LLMs using linked linguistic (meta)data Knowledge/linguistic graph embeddings KGs for model explainability, provenance, and source attribution Neural models for under-resourced languages KG-augmented RAG (KG-RAG) 3. Joint Use of KGs and LLMs in Applications Combined KG–LLM use cases with structured linguistic data Digital humanities applications Question answering over graph data Fake news and misinformation detection Educational applications and assisted learning Visualizing academic writing with KGs and LLMs KG-enhanced chatbots for health and medical contexts Application Domains All application domains are welcome (Digital Humanities, FinTech, Linguistics, Education, Cybersecurity, etc.) as long as the work uses both Knowledge Graphs and Large Language Models. Submission Guidelines Submission Format: Papers up to 8 pages excluding references. Style: All submissions must follow the LREC 2026 format and use the official LREC author kit. (available at https://lrec2026.info/authors-kit/ ) Review Process: Double-blind peer review. Submissions must be fully anonymized. Submission System: Papers must be submitted via the START conference system at https://softconf.com/lrec2026/KGLLM/ Language Resources: In line with LREC policies, authors are encouraged to describe, document, and share language resources, datasets, models, evaluation tools, or annotation guidelines used or created in their work. Accepted Papers: All accepted papers will be included in the LREC 2026 workshop proceedings. Presentation: Accepted papers will be presented as oral or poster sessions during the workshop. Important Dates *All deadlines are 11:59PM UTC-12:00 (“anywhere on Earth”)* Paper submission deadline: 26 February 2026 Notification to authors: 24 March 2026 Camera-ready due: 30 March 2026 Workshop date: 16 May 2026 Contact For questions, please contact the workshop organizers at: kg-llm-26(a)googlegroups.com Organizing Committee Gilles Sérasset, Université Grenoble Alpes, France Katerina Gkirtzou, Athena Research Center, Greece Michael Cochez, Ellis Institute Finland & Åbo Akademi, Finland Jan-Christoph Kalo, University of Amsterdam, Netherlands

1 0

The Fifth Generation, Evaluation & Metrics Workshop (GEM): 1st call for papers
by Simon Mille 16 Dec '25

16 Dec '25

Dear colleagues, Please find below information about the upcoming GEM workshop! Event Type: Call for Papers Conference: GEM at ACL 2026 Date: July 2nd or July 3rd, 2026 Location: San Diego, California, USA Website: https://gem-workshop.com/ Contact: gem-workshop-chairs(a)googlegroups.com ------------------------------ Overview The fifth edition of the Natural Language Generation, Evaluation, and Metrics (GEM) Workshop will be at ACL 2026 in San Diego! Evaluation of language models has grown to be a central theme in NLP research, while remaining far from solved. As LMs have become more powerful, errors have become tougher to spot and systems harder to distinguish. Evaluation practices are evolving rapidly—from living benchmarks like Chatbot Arena to LMs being used as evaluators themselves (e.g., LM as judge, autoraters). Further research is needed to understand the interplay between metrics, benchmarks, and human-in-the-loop evaluation, and their impact in real-world settings Topics of Interest We welcome submissions related to, but not limited to, the following topics: - Automatic evaluation of generation systems, including the use of LMs as evaluators - Creating evaluation corpora, challenge sets, and living benchmarks - Critiques of benchmarking efforts, including contamination, memorization, and validity - Evaluation of cutting-edge topics in LM development, including long-context understanding, agentic capabilities, reasoning, and more - Evaluation as measurement beyond raw capability, including ideas such as robustness, reliability, and more - Multimodal evaluation across text, vision, and other modalities - Cost-aware and efficient evaluation methods applicable across languages and scenarios - Human evaluation and its role in the era of powerful LMs - Evaluation of sociotechnical systems employing large language models - Surveys and meta-assessments of evaluation methods, metrics, and benchmarks - Best practices for dataset and benchmark documentation - Industry applications of the above-mentioned topics, especially internal benchmarking or navigating the gap between academic metrics and real-world impact. Special TracksOpinion and Statement Papers Track (New!) We are introducing a special track for opinion and statement papers. These submissions will be presented in curated panel discussions, encouraging open dialogue on emerging topics in evaluation research. We welcome bold, thought-provoking position papers that challenge conventional wisdom, propose new directions for the field, or offer critical perspectives on current evaluation practices. This track is an opportunity to spark discussion and debate—submissions need not present new empirical results but should offer well-argued viewpoints supported by scientific evidence (e.g. prior studies) that advance our collective thinking about evaluation. ReproNLP The ReproNLP Shared Task on Reproducibility of Evaluations in NLP has been run for six consecutive years (2021–2026). ReproNLP 2026 will be part of the GEM Workshop at ACL 2026 in San Diego. It aims to (i) shed light on the extent to which past NLP evaluations have been reproducible, and (ii) draw conclusions regarding how NLP evaluations can be designed and reported in order to increase reproducibility. Participants submit reports for their reproductions of human evaluations from previous NLP literature where they quantitatively assess the degree of reproducibility using methods described in Belz. (2025). More details can be found in the first call for participation for ReproNLP 2026 at https://repronlp.github.io. Workshop Format We aim to organize the workshop in an inclusive, highly interactive, and discussion-driven format. Paper presentations will focus on themed poster sessions that allow presenters to interact with researchers from varied backgrounds and similar interests. The workshop will feature panels on emerging topics and multiple short keynotes by leading experts. 🎭 GEM Comic-Con Edition! In the spirit of San Diego's famous Comic-Con (July 23-26), this year's GEM will be a special Comic-Con edition! We encourage participants to embrace creativity! Whether that’s through themed poster designs, comic-style slides, or dressing up as your favorite evaluation metric personified, we want this year's workshop to be memorable and fun! Submission Types Submissions can take any of the following forms: - Archival Papers: Original and unpublished work, for all the following tracks—Main, ReproNLP, and Opinion/Statement. - Non-Archival Extended Abstracts: Work already presented or under review at a peer-reviewed venue. This is an excellent opportunity to share recent or ongoing work with the GEM community without precluding future publication. - Findings Papers: We additionally welcome presentation of relevant papers accepted to Findings, and will share more information at a later date. All accepted papers will be given up to an additional page to address reviewers comments. Submission Guidelines - Papers to be reviewed should be submitted directly through OpenReview, selecting the appropriate track, and conform to ACL 2026 style guidelines - Review requirement: For each submitted paper, authors may be asked to provide 2 reviews (either one author doing 2 reviews, or two authors each doing one review) - Length. - Archival papers should be within 4–8 pages, and opinion/statement papers should be within 2–4 pages. We make no “Short” or “Long” paper distinctions; we advise authors to tailor their submission length proportional to their contribution. - Extended abstracts should be within 1–2 pages. - Opinion/Statement Papers: These should be titled with the “Position:” prefix. - Dual submission: Dual submission of archival papers is not allowed. Authors interested in presenting work submitted to a different venue should instead use the non-archival extended abstract track. Important Dates - March 19, 2026: Direct paper submission deadline - April 9, 2026: Pre-reviewed ARR commitment deadline - April 28, 2026: Notification of acceptance - May 14, 2026: Camera-ready paper due - June 4, 2026: Pre-recorded video due (hard deadline) - July 2–3, 2026: Workshop at ACL in San Diego Contact For any questions, please check the workshop page or email the organisers: gem-workshop-chairs(a)googlegroups.com *Dublin City University* *Simon Mille *| Postdoctoral Research Fellow ADAPT Centre School of Computing Dublin City University Dublin 9 Ireland www.adaptcentre.ie *ADAPT Taighde Éireann – Research Ireland Centre for Digital Content Technology* Privileged/confidential information: This e-mail and any files transmitted with it are confidential and are intended solely for use by the addressee. Please note that electronic mail to, from or within the College, may be the subject of a request under the Freedom of Information Act. <https://adaptcentre.us8.list-manage.com/subscribe?u=1bed8296322695727ba3517…>

1 0

CLARIN ERIC Newsflash: December 2025
by Gorgaini, E. (Elisa) 16 Dec '25

16 Dec '25

Dear colleagues, The December edition of the CLARIN Newsflash is out. Highlights include: * A review of 2025 with key achievements and milestones * Direct links to the Annual Conference recordings and an impression video, perfect inspiration if you are considering to submit your abstracts for CLARIN2026 * An overview of CLARIN’s presence at LREC including co-organised workshops Additionally, the call for extended abstracts for CLARIN 2026 is now open. Submission deadline 6 April 2026. Link to the call: https://www.clarin.eu/content/call-extended-abstracts-clarin-annual-confere… Read the newsletter: https://www.clarin.eu/content/clarin-newsflash-december-2025 Subscribe to the newsletter here<http://eepurl.com/bOt3Qn>. Kind regards, CLARIN ERIC --- Elisa Gorgaini Communication Officer - CLARIN ERIC Utrecht University | Drift 10, 3512 BS Utrecht, The Netherlands e.gorgaini(a)uu.nl<mailto:e.gorgaini@uu.nl> | elisa(a)clarin.eu<mailto:elisa@clarin.eu> www.clarin.eu<https://www.clarin.eu>

1 0

Call for Shared Task Proposals: ArgMining 2026
by Musi, Elena 16 Dec '25

16 Dec '25

We invite submissions of shared task proposals for ArgMining 2026, the 13th Workshop on Argument Mining and Reasoning, co-located with ACL 2026 (San Diego). Background Argument mining (also known as argumentation mining) is a well-established area in computational linguistics focusing on the automatic identification of argumentative structures such as premises, conclusions, and inference schemes. The field has historically emphasized the development of large-scale datasets and tasks including argument quality assessment, argument persuasiveness, and argumentative text synthesis across domains such as legal, social, medical, political, and scientific settings. In line with broader advances in CL and NLP, recent work has expanded toward explainable argumentation, multimodal settings, and modeling human label variation. Previous editions of ArgMining have promoted shared tasks to advance research on specific aspects of argument mining, including: * Multimodal argumentative fallacy detection: https://nlp-unibo.github.io/mm-argfallacy/2025/ Dialogical argument mining: http://dialam.arg.tech/ ArgMining 2026 Shared Tasks Following the success of prior workshops, ArgMining 2026 plans to feature one or more shared tasks addressing unsolved problems for the community to investigate. In keeping with this year’s special theme—“Understanding and evaluating arguments in both human and machine reasoning”—we particularly encourage proposals aligned with this focus. What to Include in a Proposal Shared task proposals should include: * Title and brief task description * Description of the datasets to be used and their readiness * Previous work on the datasets, including relevant publications (if any) * A short description of the evaluation methodology for submitted systems * Brief introduction of the task organizers * Anticipated timeline, including dates for dataset releases and final evaluation How to Submit Submit your shared task proposal via email to: argmining.org [at] gmail.com * Submission deadline: December 22, 2025 * Notification of acceptance: beginning/mid January 2026 Tentative Shared Task Schedule * Mid January: Training data release * Early March: Test data release; evaluation start * Mid/late March: Evaluation end * Early April: Results announcement * Mid April: Paper submission deadline * Mid May: Camera-ready deadline * July: ArgMining 2026 workshop (at ACL) Organizers Mohamed Elaraby (University of Pittsburgh) Annette Hautli-Janisz (University of Passau) John Lawrence (University of Dundee) Elena Musi (University of Liverpool) Julia Romberg (GESIS) Federico Ruggeri (University of Bologna)

1 0

Call for papers 13th Workshop on Argument Mining and Reasoning
by Musi, Elena 16 Dec '25

16 Dec '25

Call for Papers: ArgMining 2026 – Workshop on Argument Mining The Workshop on Argument Mining (ArgMining) provides a regular forum for presenting and discussing cutting-edge research in argument mining (a.k.a. argumentation mining) for academic and industry researchers. Continuing a series of twelve successful previous workshops, the 2026 edition welcomes submissions of long papers, short papers, extended abstracts, and PhD proposals. Workshop Theme The 2026 edition of ArgMining places a special focus on understanding and evaluating arguments in both human and machine reasoning. With this theme, we broaden the workshop’s scope to include reasoning—a long-standing area of AI research that has recently gained renewed interest within the ACL community, driven by the latest generation of large language models (LLMs). Reasoning is tightly connected to argumentation, as it represents, analyzes, and evaluates the process of reaching conclusions based on available information. Viewing argumentation as a paradigm for capturing reasoning enables the evaluation of machines (particularly LLMs) based on their ability to address argument mining tasks. Topics of Interest Topics include, but are not limited to: * Automatic extraction of textual patterns describing argument components in human and machine argumentation * Cross-lingual, cross-cultural, and multi-perspective argument mining and reasoning * Argument mining and generation from multimodal and/or multilingual data * Explainability in argument mining through reasoning * Modeling, assessing, and critically reflecting on the argumentation capabilities of LLMs * Novel benchmarks in argument mining addressing recent developments in LLM reasoning * Guidelines for assessing and documenting reasoning processes reflected in benchmarks * Annotation guidelines, linguistic analysis, and argumentation corpora * Real-world applications (e.g., social sciences, education, law, scientific writing; misinformation detection) * Integration of commonsense and domain knowledge into argumentation models * Combining information retrieval with argument mining (e.g., argumentative search engines) * Ethical aspects and societal impact of argument mining and LLM reasoning Submissions from all application areas are welcome. Submission Types The workshop accepts the following submission types: * Long Papers (archival) * Short Papers (archival) * Extended Abstracts (non-archival) * PhD Proposals (non-archival) Accepted contributions will be presented as oral or poster presentations. Archival Submissions * Long papers: * Substantial, original, completed, and unpublished work * Up to 8 pages (excluding references) * Unlimited references * Up to 2 appendix pages * 1 additional page in the final version for reviewer comments * Short papers: * Original, unpublished work with a focused contribution * Not shortened versions of long papers * Up to 4 pages (excluding references) * Unlimited references * Up to 1 appendix page * 1 additional page in the final version for reviewer comments Non-Archival Submissions * Extended abstracts: * Up to 2 pages including references * 1 additional appendix page for tables/figures * Selection based on workshop fit and the special theme * Priority given to abstracts with doctoral students as first authors unable to present at *CL conferences due to visa restrictions * PhD proposals: * Up to 4 pages * Description of PhD project, research challenges, contributions, and future directions * Presented in a dedicated poster session for feedback and discussion Multiple Submissions Policy ArgMining 2026 will not consider papers simultaneously under review elsewhere. Submissions overlapping significantly (>25%) with active ARR submissions will not be accepted. ARR-reviewed papers are allowed if reviews and meta-reviews are available by the ARR commitment deadline. Submission Format * Two-column ACL 2026 format * LaTeX or Microsoft Word templates * PDF submissions only * Submissions via OpenReview Important Dates * Direct paper submission deadline (archival): March 5, 2026 * ARR commitment deadline (archival): March 24, 2026 * Direct paper submission deadline (non-archival): April 7, 2026 * Notification of acceptance: April 28, 2026 * Camera-ready deadline: May 12, 2026 * Workshop dates: July 2–3, 2026 Review Policy Long and short papers will follow ACL double-blind review policies. Submissions must be anonymized, including self-references and links. Papers violating anonymity requirements will be rejected without review. Demo descriptions are exempt from anonymization. Best Paper Award ArgMining 2026 will present a Best Paper Award to recognize significant contributions to argument mining research. All accepted papers are eligible. Contact and Information Website: https://argminingorg.github.io/2026/ Email: argmining.org [at] gmail.com Workshop Organizers Mohamed Elaraby (University of Pittsburgh) Annette Hautli-Janisz (University of Passau) John Lawrence (University of Dundee) Elena Musi (University of Liverpool) Julia Romberg (GESIS Leibniz Institute for the Social Sciences) Federico Ruggeri (University of Bologna)

1 0

2026

2025

2024

2023

2022

Corpora December 2025