- Corpora - ELRA lists

SHROOM-Visions shared task on hallucination detection in language and vision models
by Mickus, Timothee 13 May '26

13 May '26

TL;DR SHROOM-visions<https://helsinki-nlp.github.io/shroom/2026> is a shared task to advance model-agnostic evaluation of hallucination detection for Vision-and-Language Models (VLMs). Participate in detecting fine-grained hallucination spans across 4 languages (Chinese, English, French, Italian). Stay informed by joining our Google group<https://groups.google.com/g/shroom-visions/> or our Slack<https://join.slack.com/t/shroom-shared-task/shared_invite/zt-2mmn4i8h2-HvRB…>! Full Invitation We are excited to announce the SHROOM-visions shared task on vision-language hallucination detection (link to website<https://helsinki-nlp.github.io/shroom/2026>). We invite participants to detect and classify hallucination spans in a multilingual, multimodal context, using a dataset designed for enduring evaluation. About As new foundational models emerge monthly, how do we create hallucination evaluations that remain relevant? Current benchmarks are often tied to the idiosyncrasies of specific LLMs/VLMs, risking quick obsolescence. This shared task builds upon the *SHROOM <https://helsinki-nlp.github.io/shroom/> series of hallucination detection tasks and datasets, venturing into vision-language multilingual hallucination-span prediction. With this shared-task we aim to advance detection methods that generalize across model generations and focus on the core phenomenon of hallucination. We provide a dataset of 20,000 samples annotated with a fine-grained, span-level labeling scheme: * A train set of ~15,200 samples from 5 different LVLMs. * A closed test set of 4,800 crafted samples. * A submission platform<https://shroom.pythonanywhere.com/> to evaluate the performance of your systems. * Balanced coverage across 4 languages: Chinese, English, French, Italian. * Each sample annotated by 3 annotators using a four-class taxonomy: Invention, Mischaracterization, OCR Problem, Miscounting. Participants are invited to develop systems that accurately identify and classify hallucinated text spans in image-conditioned outputs. Participants will be invited to submit system description papers, with the option to present them at the UncertaiNLP workshop<https://uncertainlp.github.io/> (co-located with EMNLP 2026). All authors of paper submissions will be asked to review peers' submissions (max 2 papers per author). Key Dates: All deadlines are “anywhere on Earth” (23:59 UTC-12). * Train set available by: 10.05.2026 * Submission platform open by: 20.05.2026 * Evaluation phase ends: 31.07.2026 * System description papers due: 10.08.2026 (TBC) * Notification of acceptance: 10.09.2026 (TBC) * Camera-ready due: 20.09.2026 (TBC) * UncertaiNLP workshop: end of October 2026 (co-located with EMNLP) Evaluation Metrics: Participants’ models must be able to produce spans corresponding to hallucinations in the text, classified along five possible categories (invention, mischaracterization, OCR problems, miscounting, and other hallucinations). The evaluation will rely on two metrics, evaluating labelled and unlabelled performances separately. Rankings and submissions will be handled separately per language: you are welcome to focus on the languages of your choice! How to Participate: * Register: Please register your team before making a submission on https://shroom.pythonanywhere.com * Submit results: use our platform to submit your results before 31.07.2026 * Submit your system description: system description papers should be submitted by 10.08.2026 (TBC, further details will be announced at a later date). Want to be kept in the loop? Join our Google group mailing list<https://groups.google.com/g/shroom-visions/> or the shared task Slack<https://join.slack.com/t/shroom-shared-task/shared_invite/zt-2mmn4i8h2-HvRB…>! We are also open to hosting Q&A sessions for groups interested in participating, you just need to send us an email. We look forward to your participation and to the exciting research that will emerge from this task. Best regards, Raúl Vázquez and Timothee Mickus On behalf of ALL the SHROOM-Visions organizers

1 0

The Paradigm Shift: From Rules to Models in Natural Language Processing
by Amal Haddad 12 May '26

12 May '26

The Paradigm Shift: From Rules to Models in Natural Language Processing International Summer School Alicante, Spain, 15, 16 and 17 June 2026 https://summer-school.gplsi.es Call for Participation See the summer school website for latest details including Preslav Nakov's recently confirmed keynote speech Natural Language Processing (NLP) has witnessed a clear paradigm shift: the transition from rule-based approaches to data-driven language models. While rule-based approaches dominated NLP for many years, during the 1990s and early 2000s they gradually gave way to statistical and machine-learning methods. It would be fair to say that data-driven models--and, most prominently, Deep Learning (DL), including more recently Large Language Models (LLMs)--have taken the world by storm. Deep Learning models are now used almost everywhere, across nearly every discipline, and Natural Language Processing is no exception. DL has proved highly promising so far, delivering improvements for almost every NLP task and application. However, as observed on numerous occasions, the outputs of DL models are not always ideal, with some studies reporting cases in which machine-learning approaches do not necessarily outperform the 'old-fashioned' rule-based ones. The overarching theme of the summer school will be this paradigm shift, with lectures and practical sessions reflecting the latest trends at both theoretical and practical levels. More specifically, the programme will combine lectures focusing on theoretical foundations with hands-on practical sessions. See the confirmed lectures below. The summer school will be ideal for both newcomers and experienced professionals in NLP, computer science, data science, cybersecurity, corpus linguistics, language technologies, and related disciplines, offering a unique opportunity to deepen expertise and engage with the rapidly evolving world of LLMs. Keynote speech: Roberto Navigli, 'Is Lexical Semantics Dead in the LLM Era?' We are delighted to announce Roberto Navigli (Sapienza University of Rome) as keynote speaker of the summer school who will deliver a keynote speech 'Is Lexical Semantics Dead in the LLM Era?' Keynote speech: Preslav Nakov, 'Towards Truly Open, Language-Specific, Safe, Factual, and Specialized Large Language Models We are equally delighted to announce Preslav Nakov (MBZUAI, Abu Dhabi) as a keynote speaker of the school summer as well. Summer school programme In addition to the above keynote speeches, the summer school programme will feature the following invited lectures: Special Invited lecture 'Quantum Natural Language Processing: Foundations, Challenges, and Insights' Ellena Lloret (University of Alicante) 'Explainable AI in Natural Language Processing' Salima Lamsiyah (University of Luxembourg) 'Quality Estimation for Machine Translation' Tharindu Ranasinghe (Lancaster University) 'Understanding Language Models' Hansi Hettiarachchi (Lancaster University) 'LLMs for low-resource languages' Robiert Sepúlveda Torres and Iván Martínez (University of Alicante) 'Fairness in Machine Learning: Evaluating Gender Bias in LLMs' Juan Pablo Consuegra-Ayala (University of Alicante) 'Gaze data for NLP research: recording methods and analysis' Cengiz Acarturk (Jagiellonian University) 'Beyond the Single Text: NLP Reading in Digital Humanities' Isuri Anuradha (Lancaster University) 'Automatic hyperparameter optimisation and model selection for NLP pipelines' Ernesto Luis Estevanell (University of Alicante) 'Legal NLP in the LLM era' Damith Premasiri (Lancaster University) 'Machine Translation for Low-Resource Languages' Alicia Picazo-Izquierdo (University of Alicante) 'Sentiment analysis: from rule-based methods to Large Language Models' Maram Alharbi (Lancaster University) Most lectures will include a practical component. Panel discussion A panel discussion 'The future of NLP methods and language models' is scheduled as part of the summer school (https://summer-school.gplsi.es/panel/). The panel will be hosted/moderated by Ruslan Mitkov (Lancaster University and University of Alicante) and will include contributions from Roberto Navigli (Sapienza University of Rome) Preslav Nakov (MBZUAI, Abu Dhabi) Elena Lloret (University of Alicante) Tharindu Ranasinghe (Lancaster University) Salima Lamsiyah (University of Luxembourg) Nasredine Semar (CEA) Yoan Gutiérrez Vázquez (University of Alicante) Gražina Korvel (Vilnius University) Venue, dates and accommodation The summer school will take place at the Research Institute of Informatics of the University of Alicante and will take place on 15, 16 and 17 June 2026. See the summer school website for recommended accommodation options (prospective participants are advised to book accommodation at their earliest convenience, as availability is limited) or more details in general. Summer School Directors Tharindu Ranasinghe (University of Lancaster) Salima Lamsiyah (University of Luxembourg) Summer School Chair Ruslan Mitkov (University of Alicante) Advisory Committee Manuel Palomar Sanz (University of Alicante) Rafael Muñoz Guillena (University of Alicante) Andrés Montoyo Guijarro (University of Alicante) Organising Committee Raúl García Cerdá (University of Alicante) Alicia Picazo Izquierdo (University of Alicante) Ernesto Luis Estevanell (University of Alicante) Maram Alharbi (Lancaster University) Iván Martínez Murillo (University of Alicante) Registration Registration can be completed at https://summer-school.gplsi.es/registration/. Kindly note that early-bird registration closes on 25 May 2026. Related events The summer school will follow the second international conference _Natural Language Processing and Artificial Intelligence_ (NLPAICS'2026) which will take place in Alicante on 11 and 12 June 2026 (https://nlpaics2026.gplsi.es). Those who register for both events will benefit from a discounted registration fee. Further information The summer school website is updated on regular basis. Alternatively, interested parties can email summer-school(a)dlsi.ua.es for more information.

1 0

Reminder: One postdoc position in NLP/CL at University of Technology Nuremberg
by Michael Roth 12 May '26

12 May '26

Just a reminder of an upcoming application deadline. O:-) The Natural Language Understanding Lab at UTN in Nuremberg [1], Germany, invites applications for a full-time postdoctoral research position (A13/E13 on the German TV-L scale). The position is based in the Department Computer Science & Artificial Intelligence and will be available from 1 July 2026 for an initial period of three years. The position is part of an award-winning research group focusing on implicit and underspecified language, background knowledge in language understanding as well as biases in data, tasks and models. The successful applicant will have the opportunity to develop their own research agenda, support ongoing research and teaching in the group, and collaborate with other groups at the university, including colleagues from the Department Liberal Arts & Social Sciences. Applicants should have a completed PhD in Natural Language Processing or Computational Linguistics as well as a track record of publications in *ACL venues, with a particular interest in semantics and/or pragmatics. They should be able to work in a team and communicate in English (German proficiency is not required). Applications should include a motivation letter outlining a proposed research agenda, a CV, a list of publications, and contact information for one or two references. Please submit all materials _as a single PDF file_ to nlu(a)utn.de. Applications received by 15 May 2026 will receive full consideration, but the position will remain open until filled. Candidates who identify as female, trans* and/or non-binary are particularly encouraged to apply. Feel free to contact michael.roth(a)utn.de for any questions regarding the group or position! [1] https://www.utn.de/en/departments/department-computer-science-artificial-in… --- Prof. Michael Roth [he/him] Natural Language Understanding Lab University of Technology Nuremberg Technische Universität Nürnberg

1 0

ConCorDial III (2026) – Call for Papers
by sascha.diwersy＠univ-montp3.fr 11 May '26

11 May '26

Dear colleagues, We are pleased to announce the third edition of ConCorDial, a conference dedicated to diachronic corpus linguistics, to be held on 12–13 November 2026 at the Université de Montpellier Paul-Valéry, Saint-Charles campus, Montpellier, France. The conference will be held in hybrid format (in-person attendance is preferred). The accepted languages of communication are French and English. THEME: Continuities, Innovations, Transitions — Linguistic and Methodological Challenges Building on the two previous editions (Grenoble 2022, Lyon 2024), ConCorDial III invites contributions on the construction, modelling, and exploration of diachronic textual data. The conference is organised around four thematic areas: 1. Corpus construction & interoperability (heterogeneity of sources, normalisation, metadata, diachronic variation) 2. Quantitative & qualitative diachronic analysis (corpus-based studies of lexical, (morpho-)syntactic, semantic or discursive phenomena) 3. Text genres in diachrony (emergence, disappearance and mutation of genres; modelling and classification) 4. LLMs & generative AI for historical text (tagging, segmentation, lemmatisation, normalisation, genre classification) Contributions may address any period in the history of French or other languages. SUBMISSION Abstracts of 300–500 words (excluding references) should be submitted in the language of the proposed presentation (French or English) via the conference website. Please submit both an anonymised version (pasted into the submission form) and an identified version (Word or PDF) including name(s) and affiliation(s). Submission site: https://concordial.sciencesconf.org KEY DATES Abstract submission deadline: 14 June 2026 Notification of acceptance: 12 July 2026 Final abstract version: 1 October 2026 Registration: 1 September – 15 October 2026 We look forward to welcoming you in Montpellier. The ConCorDial III organising committee Université de Montpellier Paul-Valéry https://concordial.sciencesconf.org/resource/page/id/1

1 0

LxGr2026: Call for Participation
by Costas Gabrielatos 11 May '26

11 May '26

11th Symposium on Corpus Approaches to Lexicogrammar (LxGr2026) LxGr2026 will be held online on Thursday 2 and Friday 3 July 2026. Invited Speakers Stefan Gries<https://www.stgries.info/> (University of California, Santa Barbara, USA) Martin Hilpert<http://members.unine.ch/martin.hilpert> (University of Neuchâtel, Switzerland) Serge Sharoff<https://ssharoff.github.io/> (University of Leeds, UK) Registration (free) is now open: https://sites.edgehill.ac.uk/lxgr The presentation abstracts are here: https://sites.edgehill.ac.uk/lxgr/lxgr2026-abstracts<https://sites.edgehill.ac.uk/lxgr/lxgr2026-abstracts/> If you have problems registering, or have any questions, please contact lxgr(a)edgehill.ac.uk<mailto:lxgr@edgehill.ac.uk>. ________________________________ Edge Hill University<http://ehu.ac.uk/home/emailfooter> Modern University of the Year, The Times and Sunday Times Good University Guide 2022<http://ehu.ac.uk/tef/emailfooter> University of the Year, Educate North 2021/21 ________________________________ This message is private and confidential. If you have received this message in error, please notify the sender and remove it from your system. Any views or opinions presented are solely those of the author and do not necessarily represent those of Edge Hill or associated companies. Edge Hill University may monitor email traffic data and also the content of email for the purposes of security and business communications during staff absence.<http://ehu.ac.uk/itspolicies/emailfooter>

1 0

Reminder: European Summer University in Digital Humanities 2026
by Elisabeth Burr 11 May '26

11 May '26

Dear all, Applications to the European Summer University in Digital Humanities "Culture and Technology" 2026 are open until*May 24 2026*. ESU DH will be held at the Université Marie et Louis Pasteur in Besançon, France, from July 6 to July 18. Submit your application via ConfTool <https://www.conftool.org/esudh2026/>. Please find more about the workshop offer and application process on our website <https://esudh.github.io/WorkshopsandLectures/>. Please note:we will be reviewing applications on a rolling basis, so if you need to arrange visa documents and organize your travel early, do submit your application early! ESU DH 2026 The Summer University offers an intense program of workshops, teaser sessions, public lectures, project presentations, a poster session, and a panel discussion. At the core of ESU are two-week workshops that run in parallel across the schedule. They are designed as comprehensive, intensive hands-on training in key areas of Digital Humanities. This year we offer 10 workshopsin the areas of: • Critical AI and Large Language Models • Distant Reading and Computational Text Analysis • Digital Archives, Cultural Heritage, and Data Curation • Phonology and Sound Analysis • Spatial Humanities and Mapping • Text Encoding and Digital Philology Building on the spirit of previous editions in Leipzig and Cluj, the ESU in Besançon aims to foster interdisciplinary collaboration between scholars and students in the Humanities, and to strengthen the community of practice established in past years. Scholarships The ESU is generously supported by our partners DARIAH, EADH, and CLARIN. Learn more about possible scholarships on our website <https://esudh.github.io/ScholarshipsandFunding/>, and stay tuned for more opportunities. Venue Besançon is a vibrant city of approximately 120,000 inhabitants and more than 25,000 students from around the world, with a long tradition of teaching French to non-native speakers. Following the two weeks of the ESU, we will offer participants the opportunity to attend two to four weeks of French language classes through our "French for DH" programme. For all relevant information, please visit our website, which will be continuously updated as new details become available. To get a sense of what to expect, we encourage you to explore the archive section. Should you have further questions, please write to esudh2026 [@] umlp.fr <http://umlp.fr> We look forward to welcoming you in Besançon. On behalf of Prof. Frederic Spagnoli, Head of the ESU 2026 Dr. Artjoms Šeļa Institute of Czech Literature, Сzech Academy of Sciences Website <https://artjomsh.github.io/web/> | Scholar <https://scholar.google.com/citations?user=4eYapmIAAAAJ&hl=en> |PoeTree <https://versologie.cz/poetree/>

1 0

NLP4CALL 2026: 1st call for papers
by Arianna Masciolini 11 May '26

11 May '26

15th NLP4CALL in Gothenburg, Sweden ___________________________________ We are happy to announce the 15th edition of the NLP4CALL workshop on Natural Language Processing for Computer-Assisted Language Learning. This year, NLP4CALL will be a two-day in-person event that will take place in Gothenburg, Sweden on November 19-20, 2026. The workshop series on Natural Language Processing (NLP) for Computer-Assisted Language Learning (NLP4CALL) is a meeting place for researchers working on integrating Natural Language Processing and Speech Technologies in CALL systems and exploring the theoretical and methodological issues arising in this connection. The latter includes, among others, the integration of insights from Second Language Acquisition (SLA) research, and the promotion of “Computational SLA” through setting up Second Language research infrastructures. The intersection of Natural Language Processing (or Language Technology / Computational Linguistics) and Speech Technology with Computer-Assisted Language Learning (CALL) brings “understanding” of language to CALL tools, thus making CALL intelligent. This fact has given the name for this area of research — Intelligent CALL, or short, ICALL. As the definition suggests, apart from having excellent knowledge of Natural Language Processing and/or Speech Technology, ICALL researchers need good insights into second language acquisition theories and practices, as well as knowledge of second language pedagogy and didactics. This workshop therefore invites a wide range of ICALL-relevant research, including studies where NLP-enriched tools are used for testing SLA and pedagogical theories, and vice versa, where SLA theories, pedagogical practices or empirical data and modeled in ICALL tools. The NLP4CALL workshop series is aimed at bringing together competences from these areas for sharing experiences and brainstorming around the future of the field. We welcome papers: - that describe research directly aimed at ICALL; - that describe the ongoing development of resources and tools with potential usage in ICALL, either directly in interactive applications, or indirectly in materials, application, or curriculum development, e.g. learning material generation, assessment of learner texts and responses, individualized learning solutions, provision of feedback; - that discuss challenges and/or research agenda for ICALL; - that describe empirical studies on language learner data. Important dates _______________ - paper submission deadline: September 24, 2026 - notification of acceptance: October 15, 2026 - camera-ready deadline: October 29, 2026 - workshop: November 19-20, 2026 All deadlines are AoE. Organizers __________ - Arianna Masciolini, Språkbanken Text, University of Gothenburg, Sweden - David Alfter, Gothenburg Research Infrastructure in Digital Humanities (GRIDH), University of Gothenburg, Sweden - Herbert Lange, Språkbanken Text, University of Gothenburg, Sweden - Ricardo Muñoz Sánchez, Språkbanken Text, University of Gothenburg, Sweden - Ildikó Pilán, Norwegian Computing Center, Norway - Elena Volodina, Språkbanken Text, University of Gothenburg, Sweden Contact _______ For more information about the workshop, you are welcome to reach out to arianna.masciolini(a)gu.se. Funding _______ This workshop is jointly supported by: - Språkbanken – jointly funded by its 10 partner institutions and the Swedish Research Council (2025–2028; project id 2023-00161); - Huminfra; - the Department of Swedish, Multilingualism, Language Technology; - the IncluEdS project.

1 0

NTCIR-19 2nd Call for Participation
by Ramon Ruiz-Dolz (Staff) 11 May '26

11 May '26

Dear colleagues, *Apologies in advance if you receive this message multiple times, as we are sharing this announcement across several mailing lists. We are delighted to send you call for NTCIR-19 participants. NTCIR (NII Testbeds and Community for Information Access Research) is a series of evaluation conferences that mainly focus on information access with East Asian languages and English. The first NTCIR conference (NTCIR-1) took place in August/September 1999, and the latest NTCIR-18 conference was held in June 2025. This round, we have 14 interesting tasks (https://research.nii.ac.jp/ntcir/ntcir-19/tasks.html), and the topics cover LLMs, IR, biomedical NLP, and financial NLP among others. We also have travel support for some participants every year. Hope you can find some topics that you are also interested in and join NTCIR in December 2026 in Tokyo. Below are more details about NTCIR-19. Feel free to contact us if you have any questions. Best Regards, The NTCIR-19 Publicity Co-chairs ■□■───────────────────────────────────────────■□■ CALL FOR NTCIR-19 TASK PARTICIPATION　　　 ■□■───────────────────────────────────────────■□■ NTCIR-19 (Dec 8-10, 2026, Tokyo, Japan) now calls for task participation of anyone interested in research on information access technologies and their evaluation, such as retrieval from a large amount of document collections, question answering and natural language processing. We welcome students, young researchers, professors who supervise students, researchers working for a company, and anyone who is interested in informatics. -------------------------------------------------- ■ What is NTCIR? -------------------------------------------------- NTCIR (NII Testbeds and Community for Information Access Research) is a project aimed at creating a large-scale evaluation framework for technologies that facilitate access to desired information, understanding, and utilization from vast amounts of data. These technologies include information retrieval, question answering, summarization, text mining, and machine translation. It provides a shared common foundation for numerous researchers both domestically and internationally, enabling them to advance their respective research, conduct validation and comparative evaluations, and learn from one another within a collaborative forum. Since it started in 1998, NTCIR has been striving to realize richer information access technologies and create future value. The project operates on a cycle of 1.5 years, during which several tasks (research areas) are selected for focused activities. -------------------------------------------------- ■ NTCIR-19 Tasks -------------------------------------------------- NTCIR-19 Program Committee has selected 14 tasks. The overview slide of each task can be available at the kick-off page: https://research.nii.ac.jp/ntcir/ntcir-19/kickoffcfp.html For more details, please visit the websites of each task: Task Overview page: https://research.nii.ac.jp/ntcir/ntcir-19/tasks.html -------------------------------------------------- == Core Tasks == - AEOLLM-2: Automatic Evaluation of LLMs 2 https://huggingface.co/spaces/THUIR/AEOLLM - FinArg-3: Argument Quality Assessment of Financial Forward-Looking Statements https://sites.google.com/nlg.csie.ntu.edu.tw/finarg3/ - HIDDEN-RAD2: Hidden Causal Reasoning in Radiology Report Generation https://sites.google.com/view/hidden-rad2/ - Lifelog-7: Advancing Lifelog Analytics and Retrieval at NTCIR19 https://lifelog-ntcir-project-bd9eae.gitlab.io/ - MedNLP-CALL: Medical Natural Language Processing for Emergency Call https://sociocom.naist.jp/mednlp-call/ - ToT: Tip-of-the-Tongue https://ntcir-tot.github.io/ == Pilot Tasks == - AgenticInstruction: Instruction Generation for Agentic Search https://geniie-lab.github.io/ntcir/ - CAMEO: Composed Access to Multimodal E-commerce Objects https://sites.google.com/view/ntcir-cameo26/ - DAGRI: Data Analytics for aGRicultural Information https://sites.google.com/view/dagri/ - FEHU: Fact-based Event-centric Human-value Understanding https://sites.google.com/view/ntcir19fehu - ModelRetrieval: Pre-trained Model Retrieval https://pre-trained-model-retrieval.github.io/ - R2C2: RAG Responses Confident and Correct? http://sakailab.com/r2c2/ - RegCom: Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking https://sites.google.com/view/ntcir19regcom/ - SciClaimEval: Cross-modal Claim Verification in Scientific Papers https://sciclaimeval.github.io/ -------------------------------------------------- ■ How to Participate -------------------------------------------------- 1. Please carefully read "How to Participate to NTCIR-19 Task(s)": https://research.nii.ac.jp/ntcir/ntcir-19/howto.html 2. Please register at https://research.nii.ac.jp/ntcir/ntcir-19/howto.html The datasets of each task will be delivered to the team after registration (the date may vary depending on the task). -------------------------------------------------- ■ Registration Due (Depend on the task) Apr 20, 2026 - R2C2: RAG Responses Confident and Correct? Jun 1, 2026 - AgenticInstruction: Instruction Generation for Agentic Search - DAGRI: Data Analytics for aGRicultural Information - FEHU: Fact-based Event-centric Human-value Understanding - ModelRetrieval: Pre-trained Model Retrieval - RegCom: Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking - SciClaimEval: Cross-modal Claim Verification in Scientific Papers - ToT: Tip-of-the-Tongue Jul 1, 2026 - MedNLP-CALL: Medical Natural Language Processing for Emergency Call Jul 10, 2026 - AEOLLM-2: Automatic Evaluation of LLMs 2 - CAMEO: Composed Access to Multimodal E-commerce Objects - FinArg-3: Argument Quality Assessment of Financial Forward-Looking Statements - HIDDEN-RAD2: Hidden Causal Reasoning in Radiology Report Generation - Lifelog-7: Advancing Lifelog Analytics and Retrieval at NTCIR19 -------------------------------------------------- ■ Schedule -------------------------------------------------- (*Schedule can be different in different tasks. Please visit the respective webpages of each task for the details.) Jan-Jun 2026 Dry run* Mar-Jul 2026 Formal run* Aug 1, 2026 Evaluation results return / Task overview release (draft) Sep 1, 2026 Submission due of participant papers (draft) Nov 1, 2026 Camera-ready participant paper due Dec 8-10, 2026 NTCIR-19 Conference (Tokyo, NII) (At the NTCIR-19 Conference, online presentation will be available) -------------------------------------------------- ■ Questions? -------------------------------------------------- For information regarding the task specifications etc., please contact the NTCIR Program Chairs: ntc19-pcc(a)nii.ac.jp<mailto:ntc19-pcc@nii.ac.jp> or task organizers. For information regarding the online registration and previous NTCIR test collections, please contact the NTCIR office: ntc-secretariat(a)nii.ac.jp<mailto:ntc-secretariat@nii.ac.jp> We are looking forward to your participation! [University of Dundee shield logo]<http://uod.ac.uk/sig-home> Dr Ramon Ruiz-Dolz Lecturer (Teaching and Research) | Open Research Lead Member of the ELLIS Society<https://ellis.eu/person/ramon-ruiz-dolz> | AFHEA School of Science and Engineering, University of Dundee rruizdolz001(a)dundee.ac.uk<mailto:rruizdolz001@dundee.ac.uk> | raruidol.github.io<http://raruidol.github.io/> Your Dundee, your University. At the heart of the city since 1881<http://uod.ac.uk/sig-strapline> University of Dundee, Nethergate, Dundee, Scotland, UK, DD1 4HN The University of Dundee is a registered Scottish Charity, No: SC015096

1 0

Call for Abstracts – Workshop “NLP tools and methods for diachronic lexical semantics” (LLcD 2026)
by Andrea Farina 11 May '26

11 May '26

Dear colleagues, We are pleased to invite submissions to the workshop NLP tools and methods for diachronic lexical semantics<https://llcd2026.sciencesconf.org/data/CfP_WS4_NLP_Diachronic_Semantics.pdf>, held as part of Languages & Language at the Crossroads of Disciplines (14-16 December 2026, Aix-en-Provence, France). The full call is available here: https://llcd2026.sciencesconf.org/data/CfP_WS4_NLP_Diachronic_Semantics.pdf. This workshop seeks to investigate whether current NLP methods and tools can support the annotation of lexical semantic features (word senses, metaphors, concrete/abstract meanings, etc.) in diachronic corpora. In particular, it aims to assess under which conditions high-quality annotation can be achieved and how this may vary depending on (i) the theoretical framework adopted; (ii) the research objective; (iii) the language under investigation; (iv) the chronological dimensions. Submission details We welcome anonymised abstracts (max. 500 words, excluding references) presenting research using NLP tools for diachronic lexical semantics, regardless of framework, language, or period. Abstracts should clearly state research questions, methods, data, and expected results. Submission deadline 17 May 2026 Submission is via EasyChair: https://easychair.org/conferences/?conf=llcd2026. Please select: WS4. NLP tools and methods for diachronic lexical semantics. Template and full call details are available on the LLcD2026 website: https://llcd2026.sciencesconf.org/. We look forward to your submissions. Best regards, Andrea Farina On behalf of the organising committee: Zinaida Geylikman Andrea Farina Barbara McGillivray Bastien Liétard

1 0

Call for Papers: Mechanistic Interpretability & Neuro-symbolic Approaches by-design: the MeMo Workshop
by fabio.massimo.zanzotto＠uniroma2.it 09 May '26

09 May '26

Willing to participate to a workshop where you can discuss work in progress and blue sky ideas ? Are you surprised about the ability of LLMs to perform complex reasoning tasks? Do you have a particular keenness for cracking the code of their inner workings? If the answer to the three questions is yes, this is the workshop for you! Observing properties and understanding the inner workings are two sides of the same coin. Another way is possible (e.g., <https://aclanthology.org/2025.findings-acl.785/> Position Paper: MeMo: Towards Language Models with Associative Memory Mechanisms - ACL Anthology)! The workshop aims to accept focused contributions on: * Mechanistic Interpretability by-design * Neuro-symbolic approaches by-design Work in progress and blue sky ideas are in the spirit of the workshop. Your contribution must be between four pages and six pages, excluding references, and should be prepared using the <https://www.overleaf.com/read/gyxkgssbstfr#85e729> Overleaf Submission Template. The proceedings will be submitted to <http://ceur-ws.org/> CEUR-WS.org for online publication. Please submit your contribution via EasyChair at the designated submission <https://easychair.org/conferences/?conf=memomina2026> link. The reviewing process is single-blind. Submission Deadline: 31/5/2026 12:00 PM AoE Acceptance Notification Date: 14/6/2026 Camera ready: 21/6/2026 Workshop Date: 24/6/2026 Venue: University of Rome Tor Vergata (Rome, Italy) & Online Registration fees: cheaper than cheap (it's free)

1 0