Corpora April 2025

corpora@list.elra.info

105 participants
144 discussions

1st CFP: EvalLAC 2025 workshop @ AIED 2025
by Shiva Taslimipoor 01 Apr '25

01 Apr '25

***** Second Workshop on Automated Evaluation of Learning and Assessment Content AIED 2025 workshop | Palermo (Italy) & Hybrid | 22-26 July 2025 https://sites.google.com/cam.ac.uk/eval-lac-2025 <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsites.goo…> ***** We are happy to announce the second edition of the Workshop on Automated Evaluation of Learning and Assessment Content will be held in Palermo (Italy) & online during the AIED 2025 conference. About the workshop Evaluation of learning and assessment content has always been a crucial task in the educational domain, but traditional approaches based on human feedback are not always usable in modern educational settings. Indeed, the advent of machine learning models, in particular Large Language Models (LLMs), enabled to quickly and automatically generate large quantities of data, making human evaluation unfeasible. Similarly, Massive Open Online Courses (MOOCs) have numbers of attending students so large that it is unsustainable to manually provide feedback to all of them. Thus, the need for accurate and automated techniques for evaluating educational content – e.g., questions, hints, and feedback – became pressing. Building on the success of the First Workshop on the Automatic Evaluation of Learning and Assessment Content, which was held at AIED 2024, this workshop aims to attract professionals from both academia and industry, and to to offer an opportunity to discuss common challenges, share best practices, and promising new research directions. Topics of interests include but are not limited to: - Question evaluation (e.g., in terms of the pedagogical criteria listed above: alignment to the learning objectives, factual accuracy, language level, cognitive validity, etc.). - Estimation of question statistics (e.g., difficulty, discrimination, response time, etc.). - Evaluation of distractors in Multiple Choice Questions. - Evaluation of reading passages in reading comprehension questions. - Evaluation of lectures and course material. - Evaluation of learning paths (e.g., in terms of prerequisites and topics taught before a specific exam). - Evaluation of educational recommendation systems (e.g., personalised curricula). - Evaluation of hints and scaffolding questions, as well as their adaptation to different students. - Evaluation of automatically generated feedback provided to students. - Evaluation of techniques for automated scoring. - Evaluation of pedagogical alignment of LLMs. - Evaluation of the ethical implications of using open-weight and commercial LLMs in education. - Evaluation of bias in educational content and LLM outputs. Human-in-the-loop approaches are welcome, provided that there is also an automated component in the evaluation and there is a focus on the scalability of the proposed approach. Papers on generation are also very welcome, as long as there is an extensive focus on the evaluation step. Important dates Submission deadline: May 25, 2025 Notification of acceptance: June 15, 2025 Camera ready: June 22, 2025 Workshop: July 22 or July 26, 2025 Submission guidelines There are two tracks, with different submission deadlines. Full and short papers: We are accepting short papers (5 pages, excluding references) and long papers (10 pages, excluding references), formatted according to the workshop style (using either the LaTeX template <https://www.overleaf.com/latex/templates/template-for-submissions-to-ceur-w…> or the DOCX template <https://ceur-ws.org/Vol-XXX/CEUR-Template-1col.docx> ). Extended abstracts: We also accept extended abstracts (max 2 pages), to showcase work in progress and preliminary results. Papers should be formatted according to the workshop style (using either the LaTeX template or the DOCX template). Submissions should contain mostly novel work, but there can be some overlap between the submission and work submitted elsewhere (e.g., summaries, focus on the evaluation phase of a broader work). Each of the submissions will be reviewed by the members of the Program Committee, and the proceedings volume will be submitted for publication to CEUR Workshop Proceedings. Due to CEUR-WS.org policies, only full and short papers will be submitted for publication, not the extended abstracts. Organisers Luca Benedetto (1), Andrew Caines (1), George Dueñas (2), Diana Galvan-Sosa (1), Gabrielle Gaudeau (1), Anastassia Loukina (3), Shiva Taslimipoor (1), Torsten Zesch (4) (1) ALTA Institute, Dept. of Computer Science and Technology, University of Cambridge (2) National Pedagogical University, Colombia (3) Grammarly, Inc. (4) FernUniversität in Hagen

1 0

2nd CFP: The 19th Linguistic Annotation Workshop (LAW-XIX)
by Ines Rehbein 01 Apr '25

01 Apr '25

Call for Papers: The 19th Linguistic Annotation Workshop (LAW-XIX) We invite submissions for LAW-XIX, co-located with ACL 2025 in Vienna, Austria, in July/Aug 2025. The LAW-XIX will provide a forum for presentation and discussion of innovative research on all aspects of linguistic annotation, including creation/evaluation of annotation schemes, methods for automatic and manual annotation, use and evaluation of annotation software and frameworks, representation of linguistic data and annotations, semi-supervised “human in the loop” methods of annotation, crowd-sourcing approaches, and more. Special Theme The special theme of LAW-XIX is "*Subjectivity and variation in linguistic annotations*". In addition to LAW's general topics, we specifically invite submissions on: * Subjectivity and human label variation in linguistic annotations * Learning from annotation disagreements * Detecting annotation noise in human label variation * Accounting for subjectivity in label aggregation * Ways to aggregate multiple annotators' labels beyond majority vote * Any other topics related to the special theme. Regarding subjectivity, we are particularly interested in work addressing the*annotation of multidimensional constructs from the political and social sciences* and encourage submissions on the following topics: * Theory-driven operationalization of complex political or socio-psychological constructs, * such as populism, moral values, or stereotypes Creation of linguistically annotated datasets that capture such constructs * Relation between theories and textual annotations * Challenges for the measurement of multidimensional constructs from text * Challenges for validating (a) theories, (b) annotations * Implications and risks for manual annotation and automatic prediction of socio-psychological constructs from text. Important Dates All submission deadlines are 11:59 p.m. UTC-12:00 “anywhere on Earth.” Workshop papers due (ARR Commitment) Mar 25, 2025 Workshop papers due (Direct Submission) April 04, 2025 Notification of acceptance May 16, 2025 Camera-ready papers due May 30, 2025 Workshop date July/Aug, 2025 Submissions Please submit your paper here: https://softconf.com/acl2025/law2025 For more information on the workshop and submission formats, please refer to the workshop homepage: https://sigann.github.io/LAW-XIX-2025 If you have any questions, please feel free to contact the program co-chairs at law2025workshop(a)gmail.com. Workshop Organizers Siyao (Logan) Peng (Program Co-Chair) Ines Rehbein (Program Co-Chair) Amir Zeldes (ACL SIGANN President) -- Ines Rehbein Data and Web Science Group University of Mannheim, Germany

1 2

2nd Call for Papers: Learner Corpus Research Graduate Conference 2025
by Cansu Akan 01 Apr '25

01 Apr '25

Dear Colleagues, In response to multiple requests, we are pleased to announce an extension for abstract submissions to the Learner Corpus Research Graduate Conference 2025, organized under the aegis of the Learner Corpus Association. The revised submission deadline is April 25, 2025. LCRGrad25 will be hosted by the Chair of English and Digital Linguistics, Chemnitz University of Technology, and will take place virtually on 22-23-24 October 2025. The main aim of the conference, as in the previous editions, is to offer a space for MA and PhD students as well as researchers who have earned their doctoral degree in the last two years prior to the conference to discuss their (ongoing) projects. Researchers who already hold a doctoral degree are welcome and strongly encouraged to attend as panelists, mentors or non-presenting delegates, helping to ensure a fruitful academic dialogue and to foster the careers of graduate students and recent graduates within the field of Learner Corpus Research. The central theme of this year’s conference is “The Pattern Beneath”. This theme celebrates the unique role of learner corpus research in uncovering the underlying structures and patterns of learner language through LCR. It emphasizes the field’s potential to provide insights into second language acquisition, linguistic development, and the intricacies of language use in educational contexts. We invite submissions across a range of formats to foster diverse discussions and engagement: • Papers (20-minute presentation): Original, completed research with substantial findings. • Work-in-Progress Paper (15-minute presentation): Presentation of ongoing research for feedback, collaborative discussions and ideas for improvement. • Workshops or Software Demonstrations (45-60 minutes): Hands-on, interactive sessions or demonstrations of corpus tools or technologies. • Roundtable Discussions (45 minutes): Topic proposals for collaborative and in-depth discussions among participants are welcome. • Panel Proposals (90 minutes): A panel with 3–4 speakers ideally made up of supervisors/senior researchers and graduate students on one of the sub-themes of LCRGrad25. • Posters: Completed research or works-in-progress in a visually engaging format. Digital posters are to be submitted with a short video (max. 3 minutes) prior to the start of the conference. The videos will be made available throughout the conference for asynchronous comments and questions. The call for papers and abstract submission guidelines can be found on the conference website: https://lcrgrad2025.tu-chemnitz.de KEYNOTE SPEAKERS Prof. Dr. Randi Reppen: Professor Emerita of Applied Linguistics and TESL at Northern Arizona University Prof. Dr. Michaela Mahlberg: Professor of Digital Humanities, Alexander-von-Humboldt Professor at Friedrich-Alexander-Universität Erlangen-Nürnberg Dr. Dana Gablasova: Senior Lecturer in Linguistics and English Language at Lancaster University IMPORTANT DATES 25.04.2025 Abstract submission deadline 10.06.25 Notification of acceptance 15.06.25 Presenter registration deadline Additional highlights of LCRGrad25: - Registration is free of charge for all participants. - Sessions will be hosted on Zoom, ensuring accessibility for participants world-wide. - To accommodate participants from various time zones, the conference will adopt a flexible and inclusive schedule. - Ask-Me-Anything Panels and Research Consultation Clinics with leading experts. - Interactive sessions connecting Early Career Researchers and Senior Academics. - Awards and recognitions for best paper and best poster. - Soft skills workshops: Hands-on sessions to enhance skills like publishing, career planning, data visualization, and networking. We look forward to your participation in this exciting virtual gathering. Best, Cansu Akan English and Digital Linguistics Chemnitz University of Technology (TU Chemnitz)

1 0

Call for Nominations for the 2025 Test-of-Time (ToT) Paper Awards
by ACL Announcements 01 Apr '25

01 Apr '25

Call for Nominations for the 2025 Test-of-Time (ToT) Paper Awards The ACL is pleased to open the call for nominations for the 2025 Test-of-Time (ToT) paper awards. In 2025, the ToT paper awards will honor up to four influential papers from ACL events from 25 and 10 years ago, namely, up to two papers from 2000 ACL events and up to two papers from 2015 ACL events. ACL ToT papers should describe research that has had a long-lasting influence on the field. That is, they should have had a significant impact on a subarea of CL, across subareas of CL, or outside of the CL research community. They may have proposed new research directions and new technologies, or released results and resources that have greatly benefited the community. All nominations will be evaluated by the Test-of-Time paper award nomination committee to decide the winners. The winners will be honored at ACL 2025. Please enter your nomination via the following form: https://forms.gle/5CspmZ8zRhQQKnma9 [1] The deadline for nominations is April 8th. - Multiple nominations by the same nominator are allowed - Self-nominations are allowed - ACL workshops from the appropriate years are included in the eligible venues. For any further information, please contact us. Best wishes, Yuki Arase (ACL conference officer) Yue Zhang (ToT paper award nomination committee co-chair) Joyce Chai (ToT paper award nomination committee co-chair) Michael Strube (ToT paper award nomination committee co-chair) Read more: https://www.aclweb.org/portal/content/call-nominations-2025-test-time-tot-p… [1] https://forms.gle/5CspmZ8zRhQQKnma9

1 0

Jump to page:

2025

2024

2023

2022

Corpora April 2025