- Corpora - ELRA lists

BEA 2025 Shared Task on Pedagogical Ability Assessment of AI-powered Tutors: Test phase begins
by Ekaterina Kochmar 11 Apr '25

11 Apr '25

(Apologies for cross-posting) Conversational agents offer promising opportunities for education as they can fulfill various roles (e.g., intelligent tutors and service-oriented assistants) and pursue different objectives (e.g., improving student skills and increasing instructional efficiency), among which serving as an AI tutor is one of the most prevalent tasks. Recent advances in the development of Large Language Models (LLMs) provide our field with promising ways of building AI-based conversational tutors, which can generate human-sounding dialogues on the fly. The key question posed in previous research, however, remains: How can we test whether state-of-the-art generative models are good AI teachers, capable of replying to a student in an educational dialogue? In this shared task, we focus on educational dialogues between a student and a tutor in the mathematical domain grounded in student mistakes or confusion, where the AI tutor aims to remediate such mistakes or confusions, with the goal of evaluating the quality of tutor responses along the key dimensions of tutor’s ability to (1) identify student’s mistake, (2) point to its location, (3) provide the student with relevant pedagogical guidance, that is also (4) actionable. Dialogues used in this shared task include the dialogue contexts from MathDial (Macina et al., 2023) and Bridge (Wang et al., 2024) datasets, including the last utterance from the student containing a mistake, and a set of responses to the last student’s utterance from a range of LLM-based tutors and, where available, human tutors, aimed at mistake remediation and annotated for their quality. Data Release We are pleased to announce that the test data is now released and can be accessed at https://github.com/kaushal0494/UnifyingAITutorEvaluation/blob/main/BEA_Shar…. Test Platform The competition is hosted on the CodaBench (https://www.codabench.org<https://www.codabench.org/>) platform, with a separate page for each track. Track 1 – Mistake Identification: https://www.codabench.org/competitions/7195/ Track 2 – Mistake Location: https://www.codabench.org/competitions/7200/ Track 3 – Providing Guidance: https://www.codabench.org/competitions/7202/ Track 4 – Actionability: https://www.codabench.org/competitions/7203/ Track 5 – Tutor Identification: https://www.codabench.org/competitions/7206/ Registered teams are welcome to participate in any number of tracks. Participation In order to participate in the test phase, you will need to create an account on CodaBench<https://www.codabench.org/>, if you don't already have one. After that, please register for the specific track(s) you wish to submit your systems' predictions to. By participating in this shared task, you are agreeing to the Terms outlined on the shared task track webpages (see tab "Terms"). The total number of submissions per each team is capped at 5 for each track (with the maximum of 2 submissions per day). The platform will ask you to provide your team name and a title for each submission – the latter may be useful to distinguish between your different submissions. All submissions will then be reflected on the CodaBench platform together with all the accompanying information (team name, affiliation, and submission name). Please note that we will publish the official final leaderboard on the shared task website (https://sig-edu.org/sharedtask/2025), where only the first 5 submissions per team will be included to adhere with the terms of this shared task. To be added to the shared task mailing list for further updates, please register here: https://forms.gle/fKJcdvL2kCrPcu8X6 Important dates All deadlines are 11:59pm UTC-12 (anywhere on Earth). - March 12, 2025: Development data release - April 10, 2025: Test data release - April 24, 2025: System submissions from teams due - April 30, 2025: Evaluation of the results by the organizers - May 21, 2025: System papers due - May 28, 2025: Paper reviews returned - June 9, 2025: Final camera-ready submissions - July 31 and August 1, 2025: BEA 2025 workshop at ACL Contact: bea.sharedtask.2025(a)gmail.com<mailto:bea.sharedtask.2025@gmail.com> Shared task website: https://sig-edu.org/sharedtask/2025

1 0

18 month postdoc position in Natural Language Processing at the University of Copenhagen
by Desmond Elliott 11 Apr '25

11 Apr '25

The Natural Language Processing Section at the Department of Computer Science at University of Copenhagen is advertising an 18 month position for a Postdoctoral Researcher in Natural Language Processing. The position involves interdisciplinary research on the development and application of large language models in public service, and sometimes sensitive legal settings, within the context of low-reserouce languages, such as Danish and order Nordic languages. Applicants should have a genuine interest in collaborating across inter-disciplinary boundaries with researchers in the areas of ethics, governance, and AI. The post is funded by the Poul Due Jensen Foundation – project: Responsible AI for Value Creation, with partners spanning several major universities in Denmark, and a collection of Danish public- and private organizations. The exact research topics are open to discussion between the successful candidate and the project co-ordinators. The successful candidate will join the Language and Multimodal Processing group, which is part of a section with a strong, international, and diverse environment for research within core as well as emerging topics in natural language processing, natural language understanding, computational linguistics, and multi-modal language processing. It is housed within the main Science Campus, which is centrally located in Copenhagen. Further information about the group is available here: https://lampgroup.github.io/, and further information about the Department is available here: https://di.ku.dk/english/. The application deadline is May 1, 2025, with interviews on the June 4, 2025, and a start date of 1 August, 2025, or as soon as possible thereafter. Further information about the position can be found here: https://candidate.hr-manager.net/ApplicationInit.aspx/?cid=1307&departmentI… Inquiries about the position can be made at de(a)di.ku.dk.

1 0

Applications for Birds of a Feather (BoF) sessions and Affinity Group meetings at ACL 2025
by ACL Announcements 11 Apr '25

11 Apr '25

Dear Applicants, The Diversity & Inclusion (D&I) chairs are delighted to invite applications for Birds of a Feather (BoF) sessions and Affinity Group meetings at ACL 2025. Please see our call at https://2025.aclweb.org/calls/bof_affinity_events/ for more details and up-to-date information. If you are interested in organizing a BoF session and/or an Affinity Group meeting to explore a specific theme in NLP and beyond, we encourage you to submit your proposals. We are here to support you in facilitating these sessions. Submission Deadline: May 25, 2025, 11:59pm (Anywhere on Earth) Notification Date: June 3, 2025, 11:59 pm (Anywhere on Earth) If you have any questions or concerns, feel free to reach out to us at acl2025diversity(a)googlegroups.com. Sincerely, ACL 2025 D&I Committee

1 0

First Call for Participation EUROLAN-2025 Summer School on NLP in the Age of Complex Networks and Agentic AI
by Nancy Ide 10 Apr '25

10 Apr '25

First Call for Participation EUROLAN-2025 Summer School on NLP in the Age of Complex Networks and Agentic AI 15 – 21 September 2025, Timișoara (Romania) & online https://conferences.info.uaic.ro/eurolan/2025/ The 17th in the series of EUROLAN biannual Schools on Natural Language Processing EUROLAN-2025 will bring together researchers and experts in machine learning, artificial intelligence (AI), reasoning systems, and computational linguistics applied to natural language processing (NLP), with a special focus on the interaction between NLP, complex networks, and agentic AI. Following the tradition of previous EUROLAN schools (see past editions <https://conferences.info.uaic.ro/eurolan/2025/?page_id=14023>), each day will feature: Morning sessions with tutorials, offering in-depth insights into key concepts. Afternoon hands-on exercises, where participants will apply lecture content to real-world problems and develop small-scale applications as a basis for future work. Brainstorming sessions and round tables, encouraging direct interaction with experts and fostering collaborative discussions. Tutorials and practical sessions will deal with the following topics: Graph-Based Representations of Text and Knowledge Social Network Analysis for Linguistic Modeling Influence Propagation and Discourse Dynamics in Online Platforms, Multimodal NLP Integrating Text, Image, and Speech Processing NLP and Autonomous AI Invited Lecturers Mădălina Chitez - West University of Timișoara Liviu Dinu - University of Bucharest Nancy Ide - Vassar College and Brandeis University Rada Mihalcea - University of Michigan Dan Tufiș - Romanian Academy Mihai Dascălu - POLITEHNICA University of Bucharest Mark Finlayson - Florida International University others TBA

1 0

ASIRF 2025- Autumn School Information Retrieval and Information Foraging - August in Dagstuhl - Call for Participation
by Thomas Mandl 10 Apr '25

10 Apr '25

Registration has opened for ASIRF 2025, the Autumn School 2025 - Information Retrieval and Information Foraging. For more information on the schedule, program, or registration: https://fg-retrieval.gi.de/veranstaltung/asirf2025 ASIRF provides a holistic perspective and shows how Information Retrieval and Information Foraging interact. In addition to conceptual and methodological knowledge from both fields, ASIRF is highly interdisciplinary. The autumn school will provide different tutorials, from foundations of Information Retrieval and Information Foraging to recent research topics such as using large language models for information retrieval tasks or applications of IR techniques in application domains. The intended audience of ASIRF are doctoral or MA students and young researchers working in Information Retrieval, Information Foraging, or using concepts or methods from these fields in their research domains. Students and lecturers will live together for a week at Schloss Dagstuhl, which guarantees the school's traditionally highly communicative and interactive atmosphere. The registration is free this year. A small number of partial travel grants are also available. The autumn school will take place at the best computer science venue ever Schloss Dagstuhl – Leibniz-Zentrum für Informatik (LZI) between 24 and 29 August 2025. The program includes the following lectures and tutorials: - Foundations of Interactive IR (Norbert Fuhr, U Duisburg-Essen) - Deep Learning for IR (Avishek Anand, TU Delft) - Conversational Search (Ralf Schenkel, U Trier) - Fairness and Bias (Andrea Horbach, U Kiel) - Multimodal retrieval and data analysis (Henning Müller, HES-SO) - User Experiments and Interactive IR (Thomas Mandl, U Hildesheim) - Complex Casual Leisure Information Needs (Vivien Petras, HU Berlin) - User Simulations for IR (Philipp Schaer, TH Köln) See you in Dagstuhl! ASIRF 2025 organizers Philipp Schaer, Ralf Schenkel, and Thomas Mandl

1 0

[ACL 2025] Applications for Birds of a Feather (BoF) sessions and Affinity Group meetings at ACL 2025
by Horacio Saggion 10 Apr '25

10 Apr '25

Dear Applicants, The Diversity & Inclusion (D&I) chairs are delighted to invite applications for Birds of a Feather (BoF) sessions and Affinity Group meetings at ACL 2025. Please see our call at https://2025.aclweb.org/calls/bof_affinity_events/ for more details and up-to-date information. If you are interested in organizing a BoF session and/or an Affinity Group meeting to explore a specific theme in NLP and beyond, we encourage you to submit your proposals. We are here to support you in facilitating these sessions. Submission Deadline: May 25, 2025, 11:59pm (Anywhere on Earth) Notification Date: June 3, 2025, 11:59 pm (Anywhere on Earth) If you have any questions or concerns, feel free to reach out to us at acl2025diversity(a)googlegroups.com. Sincerely, ACL 2025 D&I Committee -- Horacio Saggion Full Professor / Chair in Computer Science and Artificial Intelligence Head of the Natural Language Processing Group - TALN Project Coordinator iDEM Project (HE) Co-PI of the AI-BOOST project (HE) Co-PI of the IDEAL project (HE) Universitat Pompeu Fabra https://twitter.com/h_saggion https://www.linkedin.com/in/horacio-saggion-1749b916

1 0

Opera Latina Adnotata (v0.2.0)
by Giuseppe G. A. Celano 10 Apr '25

10 Apr '25

Dear all, I am glad to announce the release of Opera Latina Adnotata (v0.2.0), a multilayer Latin corpus consisting of 736 texts and 17M+ tokens searchable by: 1. word form 2. lemma 3. morphology (POS and morphological features) 4. syntax (dependency syntax following the AGDT annotation scheme) 5. CTS URN for work, author, and edition 6. CTS structure (e.g., "book," "section," etc.) 7. author name 8. work title 9. (experimental) IPA transcription of word forms (the "Classical Latin" one) The data is hosted on Zenodo [1] and can be queried online through ANNIS [2]. More information can be found in the associated repository [3]. Best regards, Giuseppe Celano ----- [1] https://zenodo.org/records/15183688 [2] https://annis.varro.informatik.uni-leipzig.de/ola020#_q=bGVtbWE9InByYWVzYWd… [3] https://github.com/OperaLatinaAdnotata/OLA -- Universität Leipzig Institute of Computer Science Augustusplatz 10 04109 Leipzig Deutschland celano(a)informatik.uni-leipzig.de

1 0

[CfP] SEMANTiCS 2025 - 1st Call for Industry & Use Case Presentations
by Kossi Amouzouvi 10 Apr '25

10 Apr '25

Call for Industry & Use Case Presentations The Industry & Use Case track at SEMANTiCS welcomes submissions that present use cases and industry adoption of semantic technology. Solutions that deal with semantic processing of data and/or information in areas like Linked Data, Knowledge Graphs, Artificial Intelligence, Machine Learning, Data Publishing, Thesaurus and/or Ontology management, and any related fields. All submissions have a strong focus on real world applications beyond the prototypical status and demonstrate the power of semantic systems! *Important dates* - *Submission Deadline:* May 14, 2025 (11:59 pm) - *Notification of Acceptance:* June 13, 2025 (11:59 pm) - *Presentation Ready:* August 18, 2025 (11:59 pm) All deadlines are set for 11:59 pm, Anywhere On Earth time (UTC-12) *Submission via Easychair on* *https://easychair.org/conferences/?conf=semantics2025* <https://easychair.org/conferences/?conf=semantics2025>. Please notice that a paper abstract is not necessary, as your submission will only include a presentation at SEMANTiCS and not a paper. Any submission should contain a summary of 200 to 300 words that will be used in the final program. Your submission must also include a full page description of the use case you want to present, in particular: initial situation, approach, business value and benefits of the semantic solution, prospects and recommendation. Submissions that don’t meet these requirements cannot be taken into account. Via Easychair, you can enter your summary in the field “Abstract”, and the full page description via the “upload paper” button. The summary will appear in the program on the webpage, the full page description will only be used in the selection process. *Topics of Interest* SEMANTiCS 2025 especially invites contributions that target the following main topics in the context of semantic-based research and systems as well as applicative domains. Topics of interest include, but are not limited to: - Large Language Models (LLM) combined with Knowledge Graphs - Enterprise Knowledge Graphs, Graph Data Management - Machine Learning Techniques for/using Knowledge Graphs (e.g. reinforcement learning, deep learning, data mining and knowledge discovery) - Knowledge Management (e.g. acquisition, capture, extraction, authoring, integration, publication) - Reasoning, rules and policies - Web Semantics & Linked (Open) Data - Natural Language Processing for/using Knowledge Graphs - Crowdsourcing for/using Knowledge Graphs - Semantics in Data Science - Trust, Data Privacy, and Security with Semantic Technologies - Authentication of knowledge graphs - IoT and Stream Processing, Linked Data Event Streams - Conversational AI and Dialogue Systems - Provenance and Data Change Tracking - Semantic Interoperability (via mapping, crosswalks, standards, etc.) *Author Guidelines and Submission* - This call for presentations reaches out to professionals in the areas related to the topics of SEMANTiCS for proposals to present industry implementations, best practices and use case prototypes, to discuss semantic systems in birds-of-a-feather sessions as well as informal settings. Additionally, we explicitly encourage the submission of software applications, apps or services that demonstrate the usefulness and benefits of semantic technologies and semantic data management. - To contribute a submission for a presentation at SEMANTiCS 2025 please prepare the following: Fill out the online application at Easychair and give us relevant information about your expertise and your professional background. - Please notice that a paper abstract is not necessary, as your submission will only include a presentation at SEMANTiCS and not a paper. Any submission should contain a summary of 200 to 300 words that will be used in the final program. Your submission must also include a full page description of the use case you want to present, iIn particular: initial situation, approach, business value and benefits of the semantic solution, prospects and recommendation. Submissions that don’t meet these requirements cannot be taken into account. - Via Easychair, you can enter your summary in the field “Abstract”, and the full page description via the “upload paper” button. The summary will appear in the program on the webpage, the full page description will only be used in the selection process. - All accepted submissions will be granted a presentation slot at the main conference. Please stick to this time pattern when preparing your talk. This is the only way we can guarantee a smooth and satisfying programme and allow all conference participants to attend as many slots as possible without missing important information. - Submissions must adhere to the fair use of Large Language Models. Please refer to the SEMANTiCS full policy for more details: https://2025-eu.semantics.cc/page/llm-policy When your submission is accepted and you are preparing your talk, please take care to address the following aspects: - *Initial Situation *What kind of challenge did you face in the beginning of the project? What problems needed to be solved? - *Approach and IT-Solution *Which approach and methodology has been chosen to tackle the problem(s)? How is your solution composed with respect to technological aspects / human aspects / organisational aspects? How do the semantic components support the process from data to knowledge? - *Success Criteria for / Benefit of the Semantic Solution *Which factors (conscious and unconscious) have been crucial to the success of your project? Which obstacles did you face? How can you measure the benefit of your solution? How does the organisation benefit from your solution? - *Prospects and Recommendations *What are the next steps planned in your project? Can you give recommendations with respect to development / deployment of semantic solutions within organisational / corporate settings? - *Demo (if applicable) *Prepare a short demonstration of your tool / service. *Review and Evaluation Criteria* Every submission will be reviewed by the Programme Committee. Submissions to this track will be evaluated according to the following criteria: - Your presentation is relevant to industry and industrial purposes. It illustrates how semantic technologies / solutions contribute to or improve existing businesses and / or generate new ones. - The presented solution has already been deployed and / or has been tested in a practical environment – at least prototypically. - Your presentation is well-structured and does bring across its message. - The topic is well described and covers enough explanations, examples, use cases, graphics, etc. - Novelty: The topic covered is new to your industry – not necessarily new to business in general In case your presentation will be accepted, we will provide you with detailed information on organisational matters according to the selection of submissions and conference participation. We are looking forward to your contribution! Marco Brattinga Artem Revenko *Industry & Use Case Track Chairs* -- DISCLAIMER: The contents of this email and any attachments are confidential. They are intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and you are herewith notified that the contents are legally privileged and that you do not have permission to disclose the contents to anyone, make copies thereof, retain or distribute or act upon it by any means, electronically, digitally or in print. The views expressed in this communication may be of a personal nature and not be representative of AIMS-NEI and/or any of its Centres or Initiatives.

1 0

CfA: International Conference on Inferentialism, Law, and Language AI, 10-13 September 2025, Zurich, Switzerland
by reto.gubelmann＠uzh.ch 09 Apr '25

09 Apr '25

Please direct any inquiries to: conference-ile(a)unisg.ch CALL FOR ABSTRACTS Exploring Reasons, Rationality, and Rationalism International Conference on Inferentialism   10 – 13 September 2025   University of Zurich & University of St. Gallen   The University of Zurich’s Digital Society Initiative (DSI), Department of Philosophy, and Department of Computational Linguistics, together with the Institute of Law & Economics of the University of St. Gallen are pleased to announce their first international conference on Inferentialism, to be held from 10 to 13 September 2025 at the University of Zurich.   This four-day event will feature contributions from leading scholars in the field as well as selected presentations from emerging young researchers. We invite submissions of extended abstracts on any topic related to rationalism and inferentialism as developed in “Reasons for Logic, Logic for Reasons” as well as applications of inferentialism in AI and the field of law.   Confirmed Keynote Speakers   • Robert Brandom (University of Pittsburgh)  • Ulf Hlobil (Concordia University, Montreal)  • Damiano Canale (Bocconi University, Milan) The publication of “Reasons for Logic, Logic for Reasons” (Brandom/Hlobil 2024) last year has marked a milestone for both the technical and the philosophical development of inferentialist logic. This conference offers a first take on the book’s reception and its potential operationalization in such diverse research fields as Epistemology, Philosophy of Language, Legal Studies, and Natural Language Processing. We invite submissions of extended abstracts that fit one of the following topics: Day 1: Are Reason Relations Universal? The first day of the conference is dedicated to the question whether reason relations, conceived as the set of all good, radically open reason relations capable of encoding material inferences in natural language use, can make up one single consistent set. Given expressivist commitments to logic as a means of explication, wouldn’t this imply the existence of a “master base vocabulary”, comprising all other possible base vocabularies as its subsets? Day 2: Inferentialism in the Legal Sphere The legal discipline is characterized by complex and partly opaque argumentation structures. Inferentialism can help to reveal the reasons why courts and scholars may accept certain conclusions on legal issues and reject others. Our workshop aims to further develop ideas on how lawyers and legal scholars can improve their practice by better understanding the structure of reasoning in complex legal settings. Day 3: Neuro-Symbolic Language AI inspired by Inferentialism Inferentialism, conceived, as a philosophical theory of the relationship between meaning and logical inference, has started to inspire innovative approaches in the area of language AI. Proposals encompass a broad range of methods, ranging from combinations of neural and symbolic methods that are informed by inferentialist semantics, to attempts at building neural architectures from scratch that are inspired by inferentialist ideas of rationalizing structures. The goal of our workshop is to bring together experts working in a broad range of language AI. Submission Guidelines   • Submissions should take the form of extended abstracts (maximum 500 words).  • Abstracts must be submitted in English and prepared for anonymous review.  • In addition to the abstract, authors must include their name, institutional affiliation, and contact information in the body of the email accompanying the submission.  • Accepted abstracts will be allocated a 25-minute presentation slot, followed by discussion.  • Please submit your abstract in PDF format to the following email address: conference-ile(a)unisg.ch Important Dates   • Submission Deadline: 31 May 2025 • Notification of Results: 30 June Scientific and Organizing Committee   • Reto Gubelmann (University of Zurich)  • Peter Hongler (University of St. Gallen)  • Ghassen Karray (University of Zurich)  • Marco Toscano (University of Zurich)    For further inquiries, please contact the organizing committee at: conference-ile(a)unisg.ch

1 0

Call for trainers: UniDive training school on diversity in NLP, Yerevan, January 2026
by Dan Zeman 09 Apr '25

09 Apr '25

* UniDive COST Action <https://unidive.lisn.upsaclay.fr/>is a scientific network dedicated to universality, diversity and idiosyncrasy in language technology. We are looking for trainers for our winter training school in Yerevan <https://unidive.lisn.upsaclay.fr/doku.php?id=meetings:other-events:2nd_unid…>, Armenia, organized at the Yerevan State University on January 20-24, 2026.The training school is dedicated tolinguistic diversityand related topics. We are interested in various aspects of diversity relevant to NLP like lexical, syntactic, semantic, typological, cultural, genre diversity, etc. We invite course proposals covering (but not necessarily restricted to) the following: * Introduction to typology for newcomers (especially from NLP) * Diversity quantification in NLP * Diversity and Large Language Models (LLMs) * LLMs for low-resourced languages * Enhancing diversity in models and datasets * Using “universalist” resources (such as Universal Dependencies or PARSEME corpora) for typological research * LLMs and language creativity vs. wooden language Proposals of courses (4 pages max.) should be sent by Monday June 2, 2025 at the latest to Dan Zeman <zeman(a)ufal.mff.cuni.cz <mailto:zeman@ufal.mff.cuni.cz>>, Verginica Mititelu <vergi(a)racai.ro <mailto:vergi@racai.ro>> and Marie-Catherine de Marneffe <marie-catherine.demarneffe(a)uclouvain.be <mailto:marie-catherine.demarneffe@uclouvain.be>>, with the subject “UniDive training school proposal”. The proposals should include: * Title of the course * Abstract, including the topics to be covered * Level (introductory, intermediate or advanced course) * Draft schedule, with a brief description of each session (max. 5 sessions of up to 2h each – the training school goes over 5 days, but courses do not have to be given every day, see the schedule of our previous training school <https://unidive.lisn.upsaclay.fr/doku.php?id=meetings:other-events:1st_unid…>) * Necessary infrastructure * Prerequisites for the trainees (bibliography to be covered, software to be installed, accounts to be created, etc.) * Bibliography (highlighting the recommended readings for the trainees) * Instructors, their affiliation, contact details and experience Important dates (anywhere on Earth): * Monday June 2, 2025: Submission of course proposals from potential trainers * Thursday June 12, 2025: Notification * Wednesday November 26, 2025: Publishing the prerequisites for the courses * Tuesday-Saturday January 20-24, 2026: Training school We cannot offer a salary for the courses themselves but long-distance travel costs of the trainers will be covered, as well as a daily allowance of 185 EUR (to cover hotel, meals and local transportation – see COST Annotated Rules <https://www.cost.eu/uploads/2025/02/COST-094-21-V2.0-Annotated-Rules-for-CO…>, Annex A1-3.1 TRAVEL REIMBURSEMENT RULES). Marie-Catherine de Marneffe, Verginica Barbu Mititelu, Agata Savary, Dan Zeman (on behalf of the UniDive Core Group) *

1 0

2025

2024

2023

2022