- Corpora - ELRA lists

1st CFP: EvalLAC 2025 workshop @ AIED 2025
by Shiva Taslimipoor 01 Apr '25

01 Apr '25

***** Second Workshop on Automated Evaluation of Learning and Assessment Content AIED 2025 workshop | Palermo (Italy) & Hybrid | 22-26 July 2025 https://sites.google.com/cam.ac.uk/eval-lac-2025 <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsites.goo…> ***** We are happy to announce the second edition of the Workshop on Automated Evaluation of Learning and Assessment Content will be held in Palermo (Italy) & online during the AIED 2025 conference. About the workshop Evaluation of learning and assessment content has always been a crucial task in the educational domain, but traditional approaches based on human feedback are not always usable in modern educational settings. Indeed, the advent of machine learning models, in particular Large Language Models (LLMs), enabled to quickly and automatically generate large quantities of data, making human evaluation unfeasible. Similarly, Massive Open Online Courses (MOOCs) have numbers of attending students so large that it is unsustainable to manually provide feedback to all of them. Thus, the need for accurate and automated techniques for evaluating educational content – e.g., questions, hints, and feedback – became pressing. Building on the success of the First Workshop on the Automatic Evaluation of Learning and Assessment Content, which was held at AIED 2024, this workshop aims to attract professionals from both academia and industry, and to to offer an opportunity to discuss common challenges, share best practices, and promising new research directions. Topics of interests include but are not limited to: - Question evaluation (e.g., in terms of the pedagogical criteria listed above: alignment to the learning objectives, factual accuracy, language level, cognitive validity, etc.). - Estimation of question statistics (e.g., difficulty, discrimination, response time, etc.). - Evaluation of distractors in Multiple Choice Questions. - Evaluation of reading passages in reading comprehension questions. - Evaluation of lectures and course material. - Evaluation of learning paths (e.g., in terms of prerequisites and topics taught before a specific exam). - Evaluation of educational recommendation systems (e.g., personalised curricula). - Evaluation of hints and scaffolding questions, as well as their adaptation to different students. - Evaluation of automatically generated feedback provided to students. - Evaluation of techniques for automated scoring. - Evaluation of pedagogical alignment of LLMs. - Evaluation of the ethical implications of using open-weight and commercial LLMs in education. - Evaluation of bias in educational content and LLM outputs. Human-in-the-loop approaches are welcome, provided that there is also an automated component in the evaluation and there is a focus on the scalability of the proposed approach. Papers on generation are also very welcome, as long as there is an extensive focus on the evaluation step. Important dates Submission deadline: May 25, 2025 Notification of acceptance: June 15, 2025 Camera ready: June 22, 2025 Workshop: July 22 or July 26, 2025 Submission guidelines There are two tracks, with different submission deadlines. Full and short papers: We are accepting short papers (5 pages, excluding references) and long papers (10 pages, excluding references), formatted according to the workshop style (using either the LaTeX template <https://www.overleaf.com/latex/templates/template-for-submissions-to-ceur-w…> or the DOCX template <https://ceur-ws.org/Vol-XXX/CEUR-Template-1col.docx> ). Extended abstracts: We also accept extended abstracts (max 2 pages), to showcase work in progress and preliminary results. Papers should be formatted according to the workshop style (using either the LaTeX template or the DOCX template). Submissions should contain mostly novel work, but there can be some overlap between the submission and work submitted elsewhere (e.g., summaries, focus on the evaluation phase of a broader work). Each of the submissions will be reviewed by the members of the Program Committee, and the proceedings volume will be submitted for publication to CEUR Workshop Proceedings. Due to CEUR-WS.org policies, only full and short papers will be submitted for publication, not the extended abstracts. Organisers Luca Benedetto (1), Andrew Caines (1), George Dueñas (2), Diana Galvan-Sosa (1), Gabrielle Gaudeau (1), Anastassia Loukina (3), Shiva Taslimipoor (1), Torsten Zesch (4) (1) ALTA Institute, Dept. of Computer Science and Technology, University of Cambridge (2) National Pedagogical University, Colombia (3) Grammarly, Inc. (4) FernUniversität in Hagen

1 0

2nd CFP: The 19th Linguistic Annotation Workshop (LAW-XIX)
by Ines Rehbein 01 Apr '25

01 Apr '25

Call for Papers: The 19th Linguistic Annotation Workshop (LAW-XIX) We invite submissions for LAW-XIX, co-located with ACL 2025 in Vienna, Austria, in July/Aug 2025. The LAW-XIX will provide a forum for presentation and discussion of innovative research on all aspects of linguistic annotation, including creation/evaluation of annotation schemes, methods for automatic and manual annotation, use and evaluation of annotation software and frameworks, representation of linguistic data and annotations, semi-supervised “human in the loop” methods of annotation, crowd-sourcing approaches, and more. Special Theme The special theme of LAW-XIX is "*Subjectivity and variation in linguistic annotations*". In addition to LAW's general topics, we specifically invite submissions on: * Subjectivity and human label variation in linguistic annotations * Learning from annotation disagreements * Detecting annotation noise in human label variation * Accounting for subjectivity in label aggregation * Ways to aggregate multiple annotators' labels beyond majority vote * Any other topics related to the special theme. Regarding subjectivity, we are particularly interested in work addressing the*annotation of multidimensional constructs from the political and social sciences* and encourage submissions on the following topics: * Theory-driven operationalization of complex political or socio-psychological constructs, * such as populism, moral values, or stereotypes Creation of linguistically annotated datasets that capture such constructs * Relation between theories and textual annotations * Challenges for the measurement of multidimensional constructs from text * Challenges for validating (a) theories, (b) annotations * Implications and risks for manual annotation and automatic prediction of socio-psychological constructs from text. Important Dates All submission deadlines are 11:59 p.m. UTC-12:00 “anywhere on Earth.” Workshop papers due (ARR Commitment) Mar 25, 2025 Workshop papers due (Direct Submission) April 04, 2025 Notification of acceptance May 16, 2025 Camera-ready papers due May 30, 2025 Workshop date July/Aug, 2025 Submissions Please submit your paper here: https://softconf.com/acl2025/law2025 For more information on the workshop and submission formats, please refer to the workshop homepage: https://sigann.github.io/LAW-XIX-2025 If you have any questions, please feel free to contact the program co-chairs at law2025workshop(a)gmail.com. Workshop Organizers Siyao (Logan) Peng (Program Co-Chair) Ines Rehbein (Program Co-Chair) Amir Zeldes (ACL SIGANN President) -- Ines Rehbein Data and Web Science Group University of Mannheim, Germany

1 2

2nd Call for Papers: Learner Corpus Research Graduate Conference 2025
by Cansu Akan 01 Apr '25

01 Apr '25

Dear Colleagues, In response to multiple requests, we are pleased to announce an extension for abstract submissions to the Learner Corpus Research Graduate Conference 2025, organized under the aegis of the Learner Corpus Association. The revised submission deadline is April 25, 2025. LCRGrad25 will be hosted by the Chair of English and Digital Linguistics, Chemnitz University of Technology, and will take place virtually on 22-23-24 October 2025. The main aim of the conference, as in the previous editions, is to offer a space for MA and PhD students as well as researchers who have earned their doctoral degree in the last two years prior to the conference to discuss their (ongoing) projects. Researchers who already hold a doctoral degree are welcome and strongly encouraged to attend as panelists, mentors or non-presenting delegates, helping to ensure a fruitful academic dialogue and to foster the careers of graduate students and recent graduates within the field of Learner Corpus Research. The central theme of this year’s conference is “The Pattern Beneath”. This theme celebrates the unique role of learner corpus research in uncovering the underlying structures and patterns of learner language through LCR. It emphasizes the field’s potential to provide insights into second language acquisition, linguistic development, and the intricacies of language use in educational contexts. We invite submissions across a range of formats to foster diverse discussions and engagement: • Papers (20-minute presentation): Original, completed research with substantial findings. • Work-in-Progress Paper (15-minute presentation): Presentation of ongoing research for feedback, collaborative discussions and ideas for improvement. • Workshops or Software Demonstrations (45-60 minutes): Hands-on, interactive sessions or demonstrations of corpus tools or technologies. • Roundtable Discussions (45 minutes): Topic proposals for collaborative and in-depth discussions among participants are welcome. • Panel Proposals (90 minutes): A panel with 3–4 speakers ideally made up of supervisors/senior researchers and graduate students on one of the sub-themes of LCRGrad25. • Posters: Completed research or works-in-progress in a visually engaging format. Digital posters are to be submitted with a short video (max. 3 minutes) prior to the start of the conference. The videos will be made available throughout the conference for asynchronous comments and questions. The call for papers and abstract submission guidelines can be found on the conference website: https://lcrgrad2025.tu-chemnitz.de KEYNOTE SPEAKERS Prof. Dr. Randi Reppen: Professor Emerita of Applied Linguistics and TESL at Northern Arizona University Prof. Dr. Michaela Mahlberg: Professor of Digital Humanities, Alexander-von-Humboldt Professor at Friedrich-Alexander-Universität Erlangen-Nürnberg Dr. Dana Gablasova: Senior Lecturer in Linguistics and English Language at Lancaster University IMPORTANT DATES 25.04.2025 Abstract submission deadline 10.06.25 Notification of acceptance 15.06.25 Presenter registration deadline Additional highlights of LCRGrad25: - Registration is free of charge for all participants. - Sessions will be hosted on Zoom, ensuring accessibility for participants world-wide. - To accommodate participants from various time zones, the conference will adopt a flexible and inclusive schedule. - Ask-Me-Anything Panels and Research Consultation Clinics with leading experts. - Interactive sessions connecting Early Career Researchers and Senior Academics. - Awards and recognitions for best paper and best poster. - Soft skills workshops: Hands-on sessions to enhance skills like publishing, career planning, data visualization, and networking. We look forward to your participation in this exciting virtual gathering. Best, Cansu Akan English and Digital Linguistics Chemnitz University of Technology (TU Chemnitz)

1 0

Call for Nominations for the 2025 Test-of-Time (ToT) Paper Awards
by ACL Announcements 01 Apr '25

01 Apr '25

Call for Nominations for the 2025 Test-of-Time (ToT) Paper Awards The ACL is pleased to open the call for nominations for the 2025 Test-of-Time (ToT) paper awards. In 2025, the ToT paper awards will honor up to four influential papers from ACL events from 25 and 10 years ago, namely, up to two papers from 2000 ACL events and up to two papers from 2015 ACL events. ACL ToT papers should describe research that has had a long-lasting influence on the field. That is, they should have had a significant impact on a subarea of CL, across subareas of CL, or outside of the CL research community. They may have proposed new research directions and new technologies, or released results and resources that have greatly benefited the community. All nominations will be evaluated by the Test-of-Time paper award nomination committee to decide the winners. The winners will be honored at ACL 2025. Please enter your nomination via the following form: https://forms.gle/5CspmZ8zRhQQKnma9 [1] The deadline for nominations is April 8th. - Multiple nominations by the same nominator are allowed - Self-nominations are allowed - ACL workshops from the appropriate years are included in the eligible venues. For any further information, please contact us. Best wishes, Yuki Arase (ACL conference officer) Yue Zhang (ToT paper award nomination committee co-chair) Joyce Chai (ToT paper award nomination committee co-chair) Michael Strube (ToT paper award nomination committee co-chair) Read more: https://www.aclweb.org/portal/content/call-nominations-2025-test-time-tot-p… [1] https://forms.gle/5CspmZ8zRhQQKnma9

1 0

PhD positions at the University of Amsterdam
by Ekaterina Shutova 01 Apr '25

01 Apr '25

PhD positions at the Institute for Logic, Language and Computation (ILLC) at the University of Amsterdam, Netherlands Salary: EUR 2.901 - EUR 3.707 gross per month Closing date: 21 April 2025 We have two open PhD positions in natural language processing (NLP), starting in September 2025 or as soon as possible thereafter. The focus of the project is on the development of methodologies for multilingual NLP and alignment of large language models. We welcome applications from candidates with an NLP / AI background and an interest in language and society. For further information and to apply: https://werkenbij.uva.nl/en/vacancies/two-phd-positions-in-natural-language… For any questions, please send an email to e.shutova(a)uva.nl

1 0

MentalRiskES@IberLEF2025: Early detection of mental risk
by María Dolores Molina González 31 Mar '25

31 Mar '25

*Registration closes today* *!!* ****We apologize for multiple postings of this e-mail**** MentalRiskES2025 describes the third edition of a novel task on early risk identification of mental disorders in Spanish comments from social media sources. The first and the second editions took place in the IberLEF evaluation forum as part of the SEPLN 2023 and SEPLN 2024. The task was resolved as an online problem, that is, the participants had to detect a potential risk as early as possible in a continuous stream of data. Therefore, the performance not only depended on the accuracy of the systems but also on how fast the problem is detected. These dynamics are reflected in the design of the tasks and the metrics used to evaluate participants. For this third edition, we propose two novel tasks, the first subtask is about the detection of the gambling disorder and the second subtask consists of detecting a type of Addiction. We would like to invite you to participate in the following tasks: 1. Risk Detection of Gambling Disorders (Binary classification) 2. Type of Addiction Detection (Multiclass classification) Find out more at https://sites.google.com/view/mentalriskes2025. MentalRiskES 2025 is part of the IberLEF Workshop and will be held in conjunction with the SEPLN 2025 conference in Zaragoza (Spain). ------------------------------------------------------------------------------- Important Dates ------------------------------------------------------------------------------- Feb 14th Registration open Feb 25th Release of trial corpora (trial server available) Mar 19th Release of training corpora *Mar 31st Registration closed* Apr 7th Release of test corpora and start of the evaluation campaign (test server available and trial submissions closed) Apr 14th End of evaluation campaign (deadline for submission of runs) Apr 18th Publication of official results and release of test gold labels May 12th Deadline for paper submission May 30th Acceptance notification Jun 16th Camera-ready submission deadline Sep TBD Publication of proceedings Note: All deadlines are 11:59PM UTC-12:00 Please reach out to the organizers at MentalRiskEs@IberLEF2025. The MentalRiskES 2025 organizing committee. ----------------------------------------------------------- Mas informacion sobre listas de correo en la Univ. de Jaen http://www.ujaen.es/sci/redes/listas/ -----------------------------------------------------------

1 0

Multi-Domain AI Text Detection Shared Task: M-DAIGT 2025 - Call for Participation
by Saad Ezzini 31 Mar '25

31 Mar '25

*Dear Colleagues,* We are pleased to announce the *Multi-Domain Detection of AI-Generated Text (M-DAIGT*) shared task, hosted at *RANLP 2025*. This task brings together researchers to explore methods for detecting AI-generated text across multiple domains, with a focus on news articles and academic writing. *We invite participation in two subtasks:* 1. *News Article Detection (NAD):* Classify news articles and snippets as human-written or AI-generated. 2. *Academic Writing Detection (AWD):* Identify AI-generated content within student coursework and academic research across various disciplines. - Participants will receive balanced datasets containing human-written and AI-generated texts from multiple language models. Evaluation will be conducted on the CodaLab platform. *Evaluation Metrics:* - *Primary:* Accuracy, Precision, Recall, F1-score - *Secondary:* Robustness across text lengths, domains, and generation sources *Important Dates:* - Training Data Release: *March 31, 2025* - Evaluation Data Release: *April 30, 2025* - Evaluation Period: *May 2–15, 2025* - Paper Submission Deadline: *May 25, 2025* - Workshop Dates: *September 11–12, 2025* *More Information and Registration:* - *Website:* https://ezzini.github.io/M-DAIGT/ - *GitHub Repository:* https://github.com/ezzini/M-DAIGT - *Registration: *Click here to register for solo or team participation <https://docs.google.com/forms/d/e/1FAIpQLSextZDY7qjGRJSLCBNISPcBNQZwusRWKvy…> - *Join us on Slack: *Slack Workspace <https://mdaigtsharedt-xye5995.slack.com/?redir=%2Fssb%2Fredirect> We look forward to your participation and encourage you to share this with colleagues who may be interested. For any queries, feel free to reach out to the organizers. *Yours sincerely,The M-DAIGT Organizers*

1 0

Call for Participation: LxMLS 2025 - 15th Lisbon Machine Learning School
by Fernando Batista 31 Mar '25

31 Mar '25

============================================================== Call for Participation LxMLS 2025 - 15th Lisbon Machine Learning School ============================================================== We invite everyone interested in Machine Learning and Natural Language Processing to attend the 15th Lisbon Machine Learning School - LxMLS 2025. Important Dates --------------- * Application Deadline: April 28th * Notification of Admission: May 13th * Early registration: June 27th * Late registration: July 12th * Summer School: July 19th-25th Topics and Intended Audience --------------- The school will cover a range of Machine Learning (ML) topics, from theory to practice, that are important in solving Natural Language Processing (NLP) problems that arise in the analysis and use of Web data. Our target audience is: * Researchers and graduate students in the fields of NLP and Computational Linguistics; * Computer scientists who have interests in statistics and machine learning; * Industry practitioners who desire a more in depth understanding of these subjects. Features of LxMLS: * No deep previous knowledge of ML or NLP is required, but the attendants are assumed to have some basic background on mathematics and programming; * Days are divided into morning lectures and afternoon lab sessions and practical talks (see schedule); * The Labs guide will be provided one month in advance. Last year's guide is available on the website. * The first day is scheduled to review basic concepts and introduce the necessary tools for implementation exercises * Both basic (e.g linear classifiers) and advanced topics (e.g. deep learning and transformers) will be covered * Welcome reception, Banquet, daily lunch as well as morning and afternoon coffee breaks are included in the application fee * Lecturers are leading researchers in machine learning and natural language processing List of Confirmed Speakers --------------- ADÈLE H. RIBEIRO Philipps-Universität Marburg | Germany ANDRÉ MARTINS University of Lisbon & Unbabel | Portugal BEIDI CHEN Carnegie Mellon University | USA BHIKSHA RAJ Carnegie Mellon University | USA DESMOND ELLIOTT University Of Copenhagen | Denmark KYUNGHYUN CHO New York University | USA LUCAS DIXON Google DeepMind MÁRIO FIGUEIREDO University of Lisbon | Portugal MAXIME PEYRARD Computer Science Laboratory of Grenoble | France NOAH SMITH University of Washington & Allen Institute for Artificial Intelligence | USA SARA HOOKER Cohere for AI | Canada SLAV PETROV Google Inc. | USA SWETA AGRAWAL Google Please visit our webpage for up-to-date information: http://lxmls.it.pt/2025/ <http://lxmls.it.pt/2025/> Apply here: http://tiny.cc/apply-lxmls2025 <http://tiny.cc/apply-lxmls2025> Any questions should be directed to: lxmls-2025(a)googlegroups.com <mailto:lxmls-2025@googlegroups.com> We are looking forward to your participation! -- The organizers of LxMLS’2025.

1 0

Deadline Extended: Call for Workshop Proposals - IJCNLP-AACL 2025
by ACL Announcements 31 Mar '25

31 Mar '25

Deadline Extended: Second Call for Workshop Proposals - IJCNLP-AACL 2025 The 14th International Joint Conference on Natural Language Processing (IJCNLP) and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) invites proposals for workshops to be held in conjunction with IJCNLP-AACL in 2025 in Mumbai (India). We solicit proposals in all areas of computational linguistics, language resources and evaluation, broadly conceived to include related disciplines such as linguistics, language documentation, natural language processing, speech and multimodal processing, computational social science, and the digital humanities. The thttps://mail.aclweb.org:2096/cpsess7732164573/3rdparty/roundcube/?_task=mail&_action=compose&_id=87201360267e9d1c02ac72#wo pages for the main proposal must include the following: - A title and a brief description of the workshop topic and content. - A list of invited speakers, if applicable, with an indication of which ones have already agreed and which are tentative, and sources of funding for the speakers, if needed. - An estimate of the number of attendees. - Workshop format: in-person preferred; hybrid format may be allowed under special circumstances. - A description of any shared tasks associated with the workshop, and estimate of the number of participants. Note that any shared task will also need to be reviewed by the workshop committee for ethical concerns. - A description of special requirements and technical needs, where relevant. If the workshop has been held before, a note specifying where previous iterations of the workshops were held, how many submissions the workshop received, how many papers were accepted (also specify whether they were not regular papers, e.g., shared task system description papers, non-archival papers), and how many attendees the workshop attracted. In order to allow more participants to join and contribute, we have decided to extend the submission deadline to April 30th, 2025, 11:59 PM Samoa Standard Time (SST) (UTC/GMT-11, ‘Anywhere on Earth). At least one of the organisers of the accepted workshops must be present in person in Mumbai, India. Check the full Call at: https://www.afnlp.org/conferences/ijcnlp2025/#submissions Link to submission system: https://softconf.com/aacl2025/workshops/ For queries related to workshop submission, and the review process in general, email: AACL-IJCNLP25-Workshop_Chairs(a)googlegroups.com Workshop Chairs Sowmya Vajjala, National Research Council, Canada Lizhen Qu, Monash University, Australia

1 0

[RANLP 2025 Shared Task] Sentiment Analysis on Arabic Dialects in the Hospitality Domain
by ahasis.task＠gmail.com 30 Mar '25

30 Mar '25

Call for Participation Sentiment Across Multi-Dialectal Arabic: A Benchmark for Sentiment Analysis in the Hospitality Domain We invite researchers, practitioners, and NLP enthusiasts to participate in the Sentiment Across Multi-Dialectal Arabic shared task, a challenge aimed at advancing sentiment analysis for Arabic dialects in the hospitality sector. About the Task: Arabic is one of the world’s most spoken languages, characterised by rich dialectal variation across different regions. These dialects significantly differ in syntax, vocabulary, and sentiment expression, making sentiment analysis a challenging NLP task. This task focuses on multi-dialectal sentiment detection in hotel reviews, where participants will classify sentiment as positive, neutral, or negative across multiple Arabic dialects, including Saudi, Moroccan, and Egyptian Arabic. This shared task provides a high-quality multi-dialect parallel dataset, enabling participants to explore: 1. Dialect-Specific Sentiment Detection – Understanding how sentiment varies across dialects. 2. Cross-Linguistic Sentiment Analysis – Investigating sentiment preservation across dialects. 3. Benchmarking on Multi-Dialect Data – Evaluating models on a standardised Arabic dialect dataset. Dataset Overview: - Hotel reviews across multiple Arabic dialects. - Balanced sentiment distribution (positive, neutral, negative). - Multi-Dialect Parallel Dataset – Each review is available in multiple dialects, allowing for cross-linguistic comparison. Evaluation Metrics: - Primary Metric: F1-Score. - Additional Analysis: Comparison of sentiment accuracy across dialects. Baseline System: - Pre-trained BERT-based model (AraBERT) fine-tuned on MSA and Arabic dialect data. - Participants are encouraged to improve upon the baseline model with their own techniques and use LLMs. Why Participate? - Contribute to Arabic NLP Research – Help advance sentiment analysis for Arabic dialects. - Gain Access to a High-Quality Dataset – A unique multi-dialect benchmark for future research. - Collaborate with the NLP Community – Engage with leading researchers and practitioners. - Showcase Your Work – High-performing models may be featured in a post-task publication. Timeline - Training data ready – April 15, 2024 - Test Evaluation starts – April 27, 2025 - Test Evaluation end – May 10, 2025 - Paper submission due – May 16, 2025 - Notification to authors – May 31, 2025 - Shared task presentation co-located with RANLP 2025 – September 11 and September 12, 2025 How to Participate? - Register for the task via https://ahasis-42267.web.app/ - Download the dataset and baseline system. - Develop and test your sentiment analysis model. - Submit your results for evaluation. Organising Team 1. Maram Alharbi, Lancaster University, UK 2. Salmane Chafik, Mohammed VI Polytechnic University, Morocco 3. Professor Ruslan Mitkov, Lancaster University, UK 4. Dr. Saad Ezzini, King Fahd University of Petroleum and Minerals, Saudi Arabia 5. Dr. Tharindo Ranasinghe, Lancaster University, UK 6. Dr. Hansi Hettiarachchi, Lancaster University, UK For inquiries, please contact us at ahasis.task(a)gmail.com

1 0

2025

2024

2023

2022