- Corpora - ELRA lists

CFP TalentCLEF @ CLEF 2025 - Skill and Job Title Intelligence for Human Capital Management
by ALVARO RODRIGO YUSTE 22 Nov '24

22 Nov '24

CALL FOR PARTICIPATION TalentCLEF @ CLEF 2025 Lab on Skill and Job Title Intelligence for Human Capital Management https://talentclef.github.io/talentclef/ Lab description: TalentCLEF introduces an innovative evaluation lab designed to foster the development of Natural Language Processing (NLP) systems in the field of Human Capital Management (HCM). In a corporate environment that is rapidly moving towards a globalized and multilingual workforce, organizations are increasingly relying on language technologies to optimize and accelerate recruitment processes. This scenario brings a critical challenge: developing systems that guarantee fairness in outcomes, with the ability to function across multiple languages and adapt to various industries. TalentCLEF addresses this challenge by creating a public benchmark, carefully considering these aspects in its design, with the aims of promoting the development and evaluation of NLP systems applied to HR, creating a meeting point for the discussion of such systems, and pushing the state-of-the-art in the area of HCM. The first edition of TalentCLEF will be held at CLEF 2025 and will have two tasks: -Task A: Multilingual Job Title Matching, where the goal is to develop systems capable of retrieving job positions similar to a given one. -Task B: Job Title-Based Skill Prediction, where teams must develop systems that identify professional skills relevant to a specific job position. More information at: https://talentclef.github.io/talentclef/ Register to our lab at: https://clef2025-labs-registration.dei.unipd.it/registrationForm.php Task organizers: Luis Gascó, Avature, Spain Hermenegildo Fabregat, Avature, Spain Laura García-Sardiña, Avature, Spain Daniel Deniz Cerpa, Avature, Spain Alvaro Rodrigo, UNED, Spain Rabih Zbib, Avature, Spain Important dates 25th October 2024 - Sample set release 13th November 2024 - Registration opens 20th January 2025 - Training data available for Tasks A and B 17th February 2025 - Start of Task A, release of development data 17th March 2025 - Start of Task B, release of development data 21st April 2025 - Test set release 21st April to 5th May 2025 - Evaluation period for both tasks 7th May 2025 - Publication of official results 15th June 2025 - Submission of CLEF 2025 Working Notes (Tentative) 30th June to 7th July 2025 - Review of labs overviews (Tentative) CLEF 2025: 9-12 September 2025, Madrid - Spain AVISO LEGAL. Este mensaje puede contener información reservada y confidencial. Si usted no es el destinatario no está autorizado a copiar, reproducir o distribuir este mensaje ni su contenido. Si ha recibido este mensaje por error, le rogamos que lo notifique al remitente. Le informamos de que sus datos personales, que puedan constar en este mensaje, serán tratados en calidad de responsable de tratamiento por la UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA (UNED) c/ Bravo Murillo, 38, 28015-MADRID-, con la finalidad de mantener el contacto con usted. La base jurídica que legitima este tratamiento, será su consentimiento, el interés legítimo o la necesidad para gestionar una relación contractual o similar. En cualquier momento podrá ejercer sus derechos de acceso, rectificación, supresión, oposición, limitación al tratamiento o portabilidad de los datos, ante la UNED, Oficina de Protección de datos<https://www.uned.es/dpj>, o a través de la Sede electrónica<https://sede.uned.es/> de la Universidad. Para más información visite nuestra Política de Privacidad<https://descargas.uned.es/publico/pdf/Politica_privacidad_UNED.pdf>.

1 0

KONVENS 2025 - Save the Date
by Christian Wartena 22 Nov '24

22 Nov '24

Save the date: KONVENS 2025: September 9th - 12th, 2025 in Hildesheim, Germany The international Conference on Natural Language Processing (KONVENS), the major conference on Natural Language Processing in the German-speaking area, will be held at Universität Hildesheim on September 9th to 12th, 2025. Conference language are English and German. Submissions on all aspects of NLP, in particular work dedicated to the German language and to the development, adaptation and/or application of Language Models in (Computational) Linguistics, Computer Science, Information Science as well as in the Humanities and Social Sciences are welcome: a Call for Papers, Posters and pre-Conference Workshops will be issued in due time. The conference is endorsed by the NLP associations of Germany, Austria and Switzerland and jointly organized by Hochschule Hannover and Universität Hildesheim. Website (still under construction): https://konvens-2025.hs-hannover.de/ -- Christian Wartena, Hochschule Hannover (christian.wartena(a)hs-hannover.de<mailto:christian.wartena@hs-hannover.de>) Ulrich Heid, University of Hildesheim (ulrich.heid(a)uni-hildesheim.de<mailto:ulrich.heid@uni-hildesheim.de>) Gertrud Faaß, University of Hildesheim (gertrud.faass(a)uni-hildesheim.de<mailto:gertrud.faass@uni-hildesheim.de>)

1 0

Call for Papers: TOIS Special Issue on Query Performance Prediction Towards Novel Information Retrieval Paradigms
by Guglielmo Faggioli 22 Nov '24

22 Nov '24

ACM Digital Library <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x332a2ax019610> [image: journal banner] <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x33ae5dx019610> *CALL FOR PAPERS* *ACM Transactions on Information Systems* *Special Issue on Query Performance Prediction Towards Novel Information Retrieval Paradigms* *Guest Editors* Dr. Suchana Datta <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341ef9x019610>, University College Dublin, Ireland Dr. Guglielmo Faggioli <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341efax019610>, University of Padua, Italy Prof. Nicola Ferro <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341efbx019610>, University of Padua, Italy Dr. Debasis Ganguly <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341efcx019610>, University of Glasgow, United Kingdom Prof. Iadh Ounis <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341efdx019610>, University of Glasgow, United Kingdom [image: journal cover image]This special issue focuses on works involving QPP models that employ or are designed for novel searching and filtering paradigms, including but not limited to neural IR, Large Language Models, and Retrieval Augmented Generation, as well as the QPP evaluation paradigms also in light of recent IR advances. QPP is a branch of IR evaluation: it is defined as the task of assessing or predicting the performance of a query without human-made relevance judgements. The focus of the special issue will be on three major topics concerning QPP: • The development of novel QPP models that employ recent neural state-of-the-art solutions, such as Large Language Models (LLMs) and semantic representations. • The application of QPP models to novel IR tasks, such as conversational search, fairness-oriented tasks, multimedia and multimodal retrieval, and Retrieval Augmented Generation (RAG). • The evaluation of QPP methods performance. *Topics*We welcome submissions on the following topics, including but not limited to: • Application of QPP to Neural Information Retrieval Systems • Usage of QPP for modern tasks, including, but not limited to, conversational search, fairness, RAG, multimodal retrieval • Usage of Large Language Models for QPP • QPPs based on non-lexical (e.g., semantic, multimodal) signals • Supervised QPP • Simulation and construction of evaluation collections with Large Language Models • QPP evaluation measures • Development of QPP evaluation collection • Performance Prediction in neighboring areas including NLP and Recommender Systems • Theory underneath QPP • Applications of QPP for downstream tasks, e.g., selective application of second-stage ranking or relevance feedback. • Explainability of QPP models and QPP models for explainability *Click here for the full Call for Papers and submission instructions.* <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341efex019610> *Important Dates* Submissions deadline: March 15, 2025 First-round review decisions: May 15, 2025 Deadline for revision submissions: July 15, 2025 Notification of final decisions: September 15, 2025 Tentative publication: Late 2025 For questions and further information, please write to *Dr. Guglielmo Faggioli* at guglielmo.faggioli(a)unipd.it <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341effx019610>. Sign up for TOIS TOC alerts. <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341f00x019610> *https://tois.acm.org* <https://maestro.acm.org/trk/click?ref=z16l2snue3_2-31603_0x341f01x019610>

1 0

The ReproHum 2024 Survey; ML researchers' experience and views of reproducibility
by Thomson, Craig 22 Nov '24

22 Nov '24

Dear Corpora list members, As part of the EPSRC UK ReproHum project, PI Prof. Anya Belz (DCU/Adapt), Co-I Prof. Ehud Reiter (University of Aberdeen), RF Dr Craig Thomson (DCU/Adapt & University of Aberdeen), we are performing a survey of NLP and ML researchers’ experience and views of reproducibility. We have sufficient responses from NLP researchers, and are now looking only for the ML researchers (including students) who do not primarily work in NLP. We would like to hear from as many researchers as possible , not just those who work on evaluation! If you completed a similar survey in 2022 we would still like you to complete this one, we are interested in the differences between then and now. We would be most grateful if you are able to spend 5-10 minutes taking part in the survey, it can be accessed via the below link: https://forms.gle/RshrHcvAXxAEEFj59 Many thanks, Craig, Anya, and Ehud The University of Aberdeen is a charity registered in Scotland, No SC013683. Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.

1 0

CFP: SemEval 2025 Task 5 - LLMs4Subjects - 2nd Call for Shared Task Participation
by Sina Zarrieß 22 Nov '24

22 Nov '24

Libraries are at the heart of our society and education, so we believe in driving technological innovation in these age-old institutions as well as modern digital libraries when we can! If you're passionate about bringing AI and LLMs into library workflows, join computer science researchers and AI enthusiasts worldwide in the LLMs4Subjects shared task! *We are excited to announce the 2nd Call for Participation to the LLMs4Subjects Shared Task organized as part of SemEval 2025.* *Overview:* As the first of its kind, LLMs4Subjects invites the research community to *develop cutting-edge LLM-based semantic solutions for the subject tagging of the Leibniz University's Technical Library's open-access collection*. The shared task provides an opportunity for the research community to creatively utilize LLMs for subject tagging of technical records. *Systems need to demonstrate bilingual language modeling in understanding technical documents in both German and English.* Moreover, successful solutions may be directly integrated into the operational workflows of the TIB Leibniz Information Centre for Science and Technology University Library. *What we provide to participants:* a human-readable form of a subject's taxonomy (this is the *GND* or *Gemeinsame Normdatei*, the integrated authority file used for cataloging in German-speaking countries) and a large collection of technical records tagged with these subjects from the TIB's open-access collection called *TIBKAT*. More details on the task website: https://sites.google.com/view/llms4subjects/ <https://sites.google.com/view/llms4subjects/> *LLMs4Subjects defines the following three tasks:* - Task 1: Learn the GND - Task 2: Align subject tagging to the TIBKAT collection - (Optional and Fun) Task 3: Develop Elegant Frontend Interfaces for Subject Tagging *LLMs4Subjects will have three separate evaluations:* - Evaluation 1: Quantitative Metrics-based Evaluations - Evaluation 2: Qualitative Evaluations by the Human Subject Specialists - (Optional) Evaluation 3: HCI evaluations for subject indexing interfaces submitted *To participate in the LLMs4Subjects shared task,* 1. please submit your interest to participate using our online form (https://forms.gle/YQzupcoySAyJi45c6 <https://forms.gle/YQzupcoySAyJi45c6>), 2. sign up to the shared task Google Groups (https://groups.google.com/u/6/g/llms4subject <https://groups.google.com/u/6/g/llms4subject>s) for FAQs, news, and announcements, and, 3. last but not the least, download the datasets (https://github.com/jd-coderepos/llms4subjects/ <https://github.com/jd-coderepos/llms4subjects/>) to begin development. *Dates* Training and validation datasets available:October 2, 2024 Test data available/Evaluation starts: January 10, 2025 Evaluation ends: January 31, 2025 Participant paper submissions due: February 28, 2025 Notification to authors: March 31, 2025 Camera ready due: April 21, 2025 SemEval workshop: TBD *Task Organizers* Jennifer D'Souza, Sameer Sadruddin, Holger Israel, Mathias Begoin et al. All organizers are affiliated with the TIB Leibniz Information Centre for Science and Technology - Germany (https://www.tib.eu/en/ <https://www.tib.eu/en/>) /We look forward to having you on board!/ *Contact: *llms4subjects [at] gmail.com <http://gmail.com/>

1 0

CFP: ACL 2025 Call for Papers
by ACL Announcements 22 Nov '24

22 Nov '24

ACL 2025 Call for Papers MAIN CONFERENCE ACL 2025 Website: https://2025.aclweb.org/ [1] Submission Deadline: February 15, 2025 Conference Dates: July 27 to August 1, 2025 Location: Vienna, Austria Special Theme: "Generalization of NLP Models" Contact: * Roberto Navigli [2] (General Chair) * Wanxiang Che [3], Joyce Nabende [4], Mohammad Taher Pilehvar [5], Ekaterina Shutova [6] (Program Chairs): For questions related to paper submission, email: editors(a)aclrollingreview.org For all other questions, email: acl2025pcs(a)gmail.com OVERVIEW ACL 2025 invites the submission of long and short papers featuring substantial, original, and unpublished research in all aspects of Computational Linguistics and Natural Language Processing. ACL 2025 has a goal of a diverse technical program--in addition to traditional research results, papers may contribute negative findings, survey an area, announce the creation of a new resource, argue a position, report novel linguistic insights derived using existing computational techniques, and reproduce, or fail to reproduce, previous results. As in recent years, some of the presentations at the conference will be of papers accepted by the Transactions of the ACL (TACL) and by the Computational Linguistics (CL) journals. Papers submitted to ACL 2025, but not selected for the main conference, will also automatically be considered for publication in the Findings of the Association of Computational Linguistics. PAPER SUBMISSION INFORMATION Papers may be submitted to the ARR 2025 February cycle. Papers that have received reviews and a meta-review from ARR (whether from the ARR 2025 February cycle or an earlier ARR cycle) may be committed to ACL 2025 via the conference commitment site (TBA). SUBMISSION TOPICS ACL 2025 aims to have a broad technical program. Relevant topics for the conference include, but are not limited to, the following areas (in alphabetical order): * Computational Social Science and Cultural Analytics * Dialogue and Interactive Systems * Discourse and Pragmatics * Efficient/Low-Resource Methods for NLP * Ethics, Bias, and Fairness * Generation * Human-centered NLP * Information Extraction * Information Retrieval and Text Mining * Interpretability and Analysis of Models for NLP * Language Modeling * Linguistic theories, Cognitive Modeling and Psycholinguistics * Machine Learning for NLP * Machine Translation * Multilinguality and Language Diversity * Multimodality and Language Grounding to Vision, Robotics and Beyond * NLP Applications * Phonology, Morphology and Word Segmentation * Question Answering * Resources and Evaluation * Semantics: Lexical and Sentence-Level * Sentiment Analysis, Stylistic Analysis, and Argument Mining * Speech recognition, text-to-speech and spoken language understanding * Summarization * Syntax: Tagging, Chunking and Parsing * Special Theme: Generalization of NLP Models ACL 2025 Theme Track: Generalization of NLP Models Following the success of the ACL 2020-2024 Theme tracks, we are happy to announce that ACL 2025 will have a new theme with the goal of reflecting and stimulating discussion about the current state of development of the field of NLP. Generalization is crucial for ensuring that models behave robustly, reliably, and fairly when making predictions on data different from their training data. Achieving good generalization is critically important for models used in real-world applications, as they should emulate human-like behavior. Humans are known for their ability to generalize well, and models should aspire to this standard. The theme track invites empirical and theoretical research and position and survey papers reflecting on the Generalization of NLP Models. The possible topics of discussion include (but are not limited to) the following: * How can we enhance the generalization of NLP models across various dimensions--compositional, structural, cross-task, cross-lingual, cross-domain, and robustness? * What factors affect the generalization of NLP models? * What are the most effective methods for evaluating the generalization capabilities of NLP models? * While Large Language Models (LLMs) significantly enhance the generalization of NLP models, what are the key limitations of LLMs in this regard? The theme track submissions can be either long or short. We anticipate having a special session for this theme at the conference and a Thematic Paper Award in addition to other categories of awards. TWO-STAGE REVIEW: SUBMISSION TO ARR, COMMITMENT TO ACL 2025 ACL 2025 will use ACL Rolling Review [7] (ARR) as a reviewing system, but final decisions will be made by the conference. Both submissions of articles for review and commitment of reviewed articles to the conference will be performed via the Open Review [8] platform. Specifically, authors will follow a two-step process: * Authors submit articles to ARR, where submissions receive reviews and meta-reviews from ARR reviewers and action editors; * Authors commit their reviewed articles to a publication venue (e.g., ACL 2025), where Senior Area Chairs and Program Chairs make acceptance decisions from the ARR reviews and meta-reviews. ACL 2025 has chosen this approach in coordination with *CL 2024 conferences, which are adopting the same procedure and a coordinated submission plan to allow maximum flexibility during their submission periods for the authors. At each cycle, after a paper has been fully reviewed, authors have the option to commit their paper to a conference or revise and resubmit for another round of reviews. The reviewing process will continue to be double-blind. Reviewers will not see authors, nor will authors see reviewers, and reviews on ARR will not be made publicly visible. However, authors will be given the option through ARR to make their anonymized submitted articles publicly visible. MANDATORY REVIEWING WORKLOAD AS THE PACE OF RESEARCH IN THE FIELD CONTINUES TO INCREASE, WE NEED TO STRENGTHEN THE COMMITMENT TO REVIEWING FOR EACH PAPER SUBMISSION. DURING THE ARR SUBMISSION PROCESS, AUTHORS WILL BE REQUIRED TO SPECIFY WHICH CO-AUTHORS ARE COMMITTING TO COVER REVIEWING IN THIS REVIEWING CYCLE. PLEASE SEE THE NEW ARR POLICY REGARDING REVIEWING WORKLOAD HERE. AS THIS IS AN ARR-WIDE POLICY FOR ALL *CL CONFERENCES, QUESTIONS OR CLARIFICATIONS SHOULD BE ADDRESSED TO ARR DIRECTLY. IMPORTANT DATES Submission deadline (all papers are submitted to ARR) February 15, 2025 ARR reviews & meta-reviews available to authors of the February cycle April 15, 2025 Commitment deadline for ACL 2025 April 20, 2025 Notification of acceptance May 15, 2025 Withdrawal deadline May 30, 2025 Camera-ready papers due May 30, 2025 Tutorials July 27, 2025 Conference July 28 - 30, 2025 Workshops July 31 - August 1, 2025 Note: All deadlines are 11:59PM UTC-12:00 ("anywhere on Earth"). Paper Submission Details Both long and short paper submissions should follow all of the ARR submission requirements [9], including: * Long Papers [10] (8 pages) and Short Papers [11] (4 pages) * Instructions for Two-Way Anonymized Review [12] * Authorship [13] * Citation and Comparison [14] * Multiple Submission Policy [15], Resubmission Policy [16], and Withdrawal Policy [17] * Ethics Policy [18] including the responsible NLP research checklist [19] * Limitations [20] * Paper Submission and Templates [21] * Optional Supplementary Materials [22] Final versions of accepted papers will be given one additional page of content (up to 9 pages for long papers, up to 5 pages for short papers) to address reviewers' comments. Following the ACL and ARR policies [23], there is no anonymity period requirement. At the time of submission to ARR, authors will be asked to select a preferred venue (e.g., ACL 2025). This is used only to calculate acceptance rates. Authors who selected ACL 2025 as a preferred venue when submitting to ARR may choose not to commit to ACL 2025 after receiving their reviews, and authors who selected a preferred venue other than ACL 2025 when submitting to ARR are still welcome to commit to ACL 2025. Presentation at the Conference All accepted papers must be presented at the conference to appear in the proceedings. The conference will include both in-person and virtual presentation options. Papers without at least one presenting author registered by the early registration deadline may be subject to desk rejection. Long and short papers will be presented orally or as posters as determined by the program committee. While short papers will be distinguished from long papers in the proceedings, there will be no distinction in the proceedings between papers presented orally and papers presented as posters. Links: ------ [1] https://2025.aclweb.org/ [2] https://www.diag.uniroma1.it/navigli/ [3] http://ir.hit.edu.cn/~car/ [4] https://sites.google.com/view/jnabende/home?authuser=0 [5] https://pilehvar.github.io/ [6] https://www.shutova.org/ [7] https://aclrollingreview.org/cfp [8] https://openreview.net/ [9] https://aclrollingreview.org/cfp#paper-submission-information [10] https://aclrollingreview.org/cfp#long-papers [11] https://aclrollingreview.org/cfp#short-papers [12] https://aclrollingreview.org/cfp#instructions-for-two-way-anonymized-review [13] https://aclrollingreview.org/cfp#authorship [14] https://aclrollingreview.org/cfp#citation-and-comparison [15] https://aclrollingreview.org/cfp#multiple-submission-policy [16] https://aclrollingreview.org/cfp#resubmission-policy [17] https://aclrollingreview.org/cfp#withdrawal-policy [18] https://aclrollingreview.org/cfp#ethics-policy [19] https://aclrollingreview.org/responsibleNLPresearch [20] https://aclrollingreview.org/cfp#limitations [21] https://aclrollingreview.org/cfp#paper-submission-and-templates [22] https://aclrollingreview.org/cfp#optional-supplementary-materials-appendice… [23] https://www.aclweb.org/portal/content/report-acl-committee-anonymity-policy

1 0

[IberLEF 2025] Call for Task Proposals
by Salud María Jiménez Zafra 21 Nov '24

21 Nov '24

================================= IberLEF 2025 -- Call for Task Proposals ================================= IberLEF (the Iberian Language Evaluation Forum) is a shared evaluation campaign of Natural Language Processing systems in Spanish and other Iberian languages, whose 2025 edition will be held as part of the 41th International Conference of the Spanish Society for Natural Language Processing (SEPLN). The 2025 edition of the SEPLN conference will take place in Zaragoza, Spain. The goal of IberLEF is to encourage the research community to organize competitive text processing, understanding and generation tasks, with the aim of defining new research challenges and advancing the state of the art in Natural Language Processing challenges involving at least one of the following Iberian languages: Spanish, Portuguese, Catalan, Basque or Galician. Researchers and practitioners from all areas of Natural Language Processing and related communities are invited to submit task proposals that fit IberLEF goals by December 22, 2024. Proposals must be submitted (as a pdf file) to iberlef(a)googlegroups.com, and should include the following fields: - Title of the task. - Description of the task, highlighting: - Relevance and novelty of the task, and the challenges involved. - Evaluation measures, and other relevant methodological aspects. - Expected target community, and actual or potential industrial takeup. - Related evaluation activities, if any. - Previous editions of the task, if any. If it has been organized previously, what the roadmap is and what the novelties for 2024 are. - Linguistic resources to be gathered, created and/or reused. Please include as many details on data gathering, selection and annotation procedures as possible: sources and representativity, training/validation/test sizes, harvesting procedures, profile of annotators (experts, linguists, crowdworkers, etc.), multiple annotation policy, IPR issues, baselines, etc. - Tentative schedule (note that camera-ready versions of the proceedings must be ready by July 3, 2025). - Organization committee: full name and affiliation of the organizers, with a succinct description of their research interests, areas of expertise and experience organizing similar events. - Funding, if available. - Contact person. - Any other relevant issues. Task organizers duties Note that organizers of accepted tasks are expected to: - Set up the evaluation exercise according to the submitted proposal. - Promote the task within the target research community. - Manage the submission and scientific evaluation of the system description papers of the corresponding systems submitted by the participants. The accepted papers will be published in the IberLEF proceedings. - Prepare and submit an overview of the evaluation exercise. - Present the results of the task at IberLEF 2025. Task selection procedure Each submitted proposal will be reviewed by members of the IberLEF steering and program committee, and decisions will be sent back to the task organizers by January 24, 2025. Proceedings IberLEF 2025 Proceedings including the description of the participating systems will be published at CEUR-WS.org. Task Overviews will be published in the SEPLN journal (http://www.sepln.org/en/journal, indexed in Clarivate ESCI (JCI: 0.21), CiteScore (Scopus): 2,9 and SJR: 0,421) in its September 2025 issue. Task Organizers are expected to notify participants the acceptance of their works by June 20, 2025, and send the camera ready task and system description papers for their task to IberLEF organizers by July 3, 2025. Important dates - Task proposals due: December 22, 2024. - Notification of acceptance: January 24, 2025. - Final date for sending paper acceptance to task participants: June 20, 2025. - Camera ready submissions due: July 3, 2025. - IberLEF Workshop: September 2025. IberLEF general chairs Salud María Jiménez Zafra, SINAI, Universidad de Jaén (Spain) Luis Chiruzzo, Universidad de la República (Uruguay) José Ángel González Barba, Symanto Research (Spain) Website https://sites.google.com/view/iberlef-2025 Contact E-mail: iberlef(a)googlegroups.com ================================= [image: Universidad de Jaén] <http://www.uja.es/> *Salud María Jiménez Zafra* sjzafra(a)ujaen.es Universidad de Jaén Grupo de Investigación SINAI <http://sinai.ujaen.es/> | Departamento de Informática EPS Jaén, Edificio A3, Despacho 326 Campus Las Lagunillas s/n 23071 - Jaén | +34 953212992 [image: Universidad de Jaén] <http://www.uja.es/>

1 0

The First Workshop on Multilingual Counterspeech Generation (COLING 2025) : SUBMISSION DEADLINE EXTENDED
by mevallec＠ujaen.es 21 Nov '24

21 Nov '24

Background and Scope --------------------- While interest in automatic approaches to Counterspeech generation has been steadily growing, including studies on data curation (Chung et al., 2019a; Fanton et al., 2021), detection (Chung et al., 2021a; Mathew et al., 2018), and generation (Tekiroglu et al., 2020; Chung et al., 2021b; Zhu and Bhat, 2021; Tekiroglu et al., 2022), the large majority of the published experimental work on automatic Counterspeech generation has been carried out for English. This is due to the scarcity of both non-English manually curated training data and to the crushing predominance of English in the generative Large Language Models (LLMs) ecosystem. A workshop on exploring Multilingual Counterspeech Generation is proposed to promote and encourage research on multilingual approaches for this challenging topic. Thus, this workshop aims to test monolingual and multilingual LLMs in particular and Language Technology in general to automatically generate counterspeech not only in English but also in languages with fewer resources. In this sense, an important goal of the workshop will be to understand the impact of using LLMs, considering for example how to deal with pressing issues such as biases, hallucinated content, data scarcity or data contamination. We seek to maximize the scientific and social impact of this workshop by promoting the creation of a community of researchers from diverse fields, such as computer and social sciences, as well as policy makers and other stakeholders interested in automatic counterspeech generation. By doing so we aim to gain a deeper understanding of how counterspeech is currently used to tackle abuse by individuals, activists, and organizations and how Natural Language Processing (NLP) and Generation (NLG) may be best applied to counteract it. Call for Papers --------------------- We welcome submissions on the following topics (but not limited to): - Models and methods for generating counterspeech in different languages. - Automatic Counterspeech generation for low resource languages with scarce training data. - Dialogue agents that use counterspeech to combat offensive messages that are directed to individuals or groups, targeted based on various aspects such as ideology, gender, sexual orientation and religion. - Methods for human and automatic evaluation of counterspeech. - Multidisciplinary studies providing different perspectives on the topic such as computer science, social science, psychology, etc. - Development of taxonomies and quality datasets for counterspeech in multiple languages. - Potentials and limitations (e.g., fairness, biases, hallucinated content) of applying different NLP methods, such as LLMs, to generate counterspeech. - Social impact and empirical studies of counterspeech in social networks, including research on the effectiveness and consequences for users of using counterspeech to combat hate online. Submission --------------------- We welcome two types of papers: regular workshop papers and non-archival submissions. Regular workshop papers will be included in the workshop proceedings. All submissions must be in PDF format and made through START [https://softconf.com/coling2025/MCG25/] - Regular workshop papers: Authors can submit papers up to 8 pages, with unlimited pages for references. Authors may submit up to 100 MB of supplementary materials separately and their code for reproducibility. All submissions undergo an double-blind single-track review. Accepted papers will be presented as posters with the possibility of oral presentations. - Non-archival submissions: Cross-submissions are welcome. Accepted papers will be presented at the workshop, but will not be included in the workshop proceedings. Papers must be in PDF format and will be reviewed in a double-blind fashion by workshop reviewers. We also welcome extended abstracts (up to 2 pages) of papers that are work in progress, under review or to be submitted to other venues. Papers in this category need to follow the COLING format. Important Dates --------------------- - Submission: November 25th, 2024 - Notification of Acceptance: December 8th, 2024 - Camera-Ready Papers Due: December 13th, 2024

1 0

MultiGEC-2025 shared task: DEADLINE EXTENDED
by Arianna Masciolini 21 Nov '24

21 Nov '24

MultiGEC-2025 shared task: system submission deadline extended to November 29, 2024 We renew our invitation to participate in the MultiGEC-2025 shared task on Multilingual Grammatical Error Correction, covering 12 languages: Czech, English, Estonian, German, Greek, Icelandic, Italian, Latvian, Russian, Slovene, Swedish and Ukrainian. The system submissions deadline is now extended to November 29, 2024. System output is to be submitted via CodaLab (https://codalab.lisn.upsaclay.fr/competitions/20500) The results will be presented on March 5th 2025, at the NLP4CALL workshop, co-located with the NoDaLiDa conference to be held in Estonia, Tallinn, on 2--5 March 2025. https://spraakbanken.gu.se/en/research/themes/icall/nlp4call-workshop-serie… The publication venue for system descriptions will be the proceedings of the NLP4CALL workshop, also co-published in the ACL anthology. To register for/express interest in the shared task and get access to the data, please fill in this form (https://forms.gle/nTPfARVqy1XmqT4t6). Note that you will be prompted to sign Terms of Use for the data at https://forms.gle/VLJ18WbwsxitEBYi7. Data access is personal, please do not forget to fill in the form. You are also welcome to join the MultiGEC-2025 Google group (https://groups.google.com/g/multigec-2025) in order to ask questions, hold discussions and browse for already answered questions about the shared task. The task description below, as well as general information, is also available on our website https://spraakbanken.gu.se/en/compsla/multigec-2025 and GitHub repository https://github.com/spraakbanken/multigec-2025/ * TASK DESCRIPTION In this shared task, your goal is to rewrite learner-written texts to make them grammatically correct or both grammatically correct and idiomatic, that is either adhering to the "minimal correction" principle or applying fluency edits. For instance, the text > My mother became very sad, no food. But my sister better five months later. can be corrected minimally as > My mother became very sad, and ate no food. But my sister felt better five months later. or with fluency edits as > My mother was very distressed and refused to eat. Luckily, my sister recovered five months later. For fair evaluation of both approaches to the correction task, we will provide two evaluation metrics, one favoring minimal correction, one suited for fluency-edited output (read more under Evaluation). We particularly encourage development of multilingual systems that can process all (or several) languages using a single model, but this is not a mandatory requirement to participate in the task. * DATA We provide training, development and test data for each of the languages. The training and development dataset splits are available through Github. Evaluation will be performed on a separate test set. See website for more detailed information: https://github.com/spraakbanken/multigec-2025/ Note: The English data is expected a bit later. * EVALUATION During the shared task, evaluation will be based on cross-lingually applicable automatic metrics: - reference-based: - GLEU score - Precision, Recall, F0.5 score - reference-free: Scribendi score After the shared task, we also plan on carrying out a human evaluation experiment on a subset of the submitted results. * TIMELINE - June 18, 2024 - first call for participation ✓ - September 20, 2024 - second call for participation ✓ - October 20, 2024 - third call for participation. Training and validation data released ✓ - October 31, 2024 - reminder. CodaLab opens for team registrations, validation phase starts ✓ - November 13, 2024 - test phase starts ✓ - November 29, 2024 (extended) - system submission deadline (system output) - December 2, 2024 - results announced - December 16, 2024 - paper submission deadline with system descriptions - January 20, 2025 - paper reviews sent to the authors - February 3, 2025 - camera-ready deadline - March 5, 2025 - presentations of the systems at the NLP4CALL workshop * PUBLICATION We encourage you to submit a paper with your system description to the NLP4CALL workshop special track. We follow the same requirements for paper submissions as the NLP4CALL workshop, i.e. we use the same template and apply the same page limit. All papers will be reviewed by the organizing committee. Upon paper publication, we encourage you to share models, code, fact sheets, extra data, etc. with the community through GitHub or other repositories. * ORGANIZERS - Arianna Masciolini, University of Gothenburg, Sweden - Andrew Caines, University of Cambridge, UK - Orphée De Clercq, Ghent university, Belgium - Joni Kruijsbergen, Ghent university, Belgium - Murathan Kurfali, Stockholm University, Sweden - Ricardo Muñoz Sánchez, University of Gothenburg, Sweden - Elena Volodina, University of Gothenburg, Sweden - Robert Östling, Stockholm University, Sweden * DATA PROVIDERS - Czech: -- Alexandr Rosen, Charles University, Prague - English: -- Diane Nicholls, ELiT, Cambridge University Press & Assessment -- Andrew Caines, University of Cambridge -- Paula Buttery, University of Cambridge - Estonian: -- Mark Fishel, University of Tartu, Estonia -- Kais Allkivi, Tallinn University, Estonia -- Kristjan Suluste, Eesti Keele Instituut, Estonia - German: -- Andrea Horbach, IPN / CAU Kiel, Germany -- Josef Ruppenhofer, FernUniversität in Hagen, Germany -- Katrin Wisniewski, Universität Leipzig -- Torsten Zesch, FernUniversität in Hagen, Germany - Greek: -- Alex Tantos, Aristotle University of Thessaloniki -- Konstantinos Tsiotskas, Aristotle University of Thessaloniki -- Vassilis Varsamopoulos, Aristotle University of Thessaloniki -- Pinelopi Kikilintza, Aristotle University of Thessaloniki -- Elena Drakonaki, Aristotle University of Thessaloniki -- Eleni Tsourilla, Aristotle University of Thessaloniki -- Despoina-Ourania Touriki, Aristotle University of Thessaloniki - Icelandic: -- Isidora Glisič, University of Iceland - Italian: -- Jennifer-Carmen Frey, Eurac Research Bolzano, Italy -- Lionel Nicolas, Eurac Research Bolzano, Italy - Latvian: -- Roberts Darģis, University of Latvia -- Ilze Auzina, University of Latvia - Russian: -- Alla Rozovskaya, City University of New York (CUNY), USA - Slovene: -- Špela Arhar Holdt, University of Ljubljana, Slovenia -- Aleš Žagar, University of Ljubljana, Slovenia - Swedish: -- Arianna Masciolini, University of Gothenburg, Sweden - Ukrainian: -- Oleksiy Syvokon, Microsoft -- Mariana Romanyshyn, Grammarly * CONTACT Please join the MultiGEC-2025 Google group (https://groups.google.com/g/multigec-2025) in order to ask questions, hold discussions and browse for already answered questions.

1 0

Text2Story@ECIR'25 Call for Papers
by Hugo Sousa 21 Nov '24

21 Nov '24

*** Apologies for cross-posting *** ++ CALL FOR PAPERS ++ **************************************************************************** Eighth International Workshop on Narrative Extraction from Texts (Text2Story'25) Held in conjunction with the 47th European Conference on Information Retrieval (ECIR'25) April 10th, 2025 – Lucca, Italy Website: https://text2story25.inesctec.pt **************************************************************************** ++ Important Dates ++ - Submission Deadline: January 24th, 2025 - Acceptance Notification: March 3rd, 2025 - Camera-ready copies: March 17th, 2025 - Workshop: April 10th, 2025 ++ Overview ++ For seven years, the Text2Story Workshop series has fostered a vibrant community dedicated to understanding narrative structure in text, resulting in significant contributions to the field and developing a shared understanding of the challenges in this domain. While traditional methods have yielded valuable insights, the advent of Transformers and LLMs have ignited a new wave of interest in narrative understanding. In the eighth edition of the Text2Story workshop, we propose to go deeper into the role of LLMs in narrative understanding exploring the issues involved in using LLMs to unravel narrative structures, while also examining the characteristics of narratives generated by LLMs. By fostering dialogue on these emerging areas, we aim to identify the wide-ranging issues related to the narrative extraction task and continue the workshop's tradition of driving innovation in narrative understanding research. ++ List of Topics ++ Research works submitted to the workshop should advance the scientific understanding of all aspects of narrative extraction from texts. This includes, but is not limited to, topics such as narrative information extraction, formal representation of narratives, narrative analysis and generation, development of datasets and evaluation protocols, as well as ethics and bias in narratives, and narrative applications. We encourage the submission of high-quality and original submissions covering the following topics and contributions focused on low and medium-resource languages. Narrative Information Extraction - Identification of Participants, Events and Temporal Expressions - Identification of Participants, Events and Temporal Expressions - Temporal Reasoning and Ordering of Events - Causality Detection - Big Data Applied to Narrative Extraction - LLMs for Narrative Extraction Narrative Representation - Annotation Protocols - Narrative Representation Models - Lexical, Syntactic, and Semantic Ambiguity in Narrative Representation - LLM-learned Representation Narrative Analysis and Generation - Discourse and Argument Structure Analysis - Narrative analysis of LLM generated text - Multilingual and Cross-lingual Narrative Analysis - Story Evolution and Shift Detection - Automatic Timeline Generation - Generative Language Models for Narrative Generation Datasets and Evaluation Protocol - Evaluating LLM-Generated Narratives - Evaluation of Multimodal Narrative Models - Annotated datasets - Narrative Resources - Using LLMs for Data Creation and Augmentation Ethics and Bias in Narratives - Identifying and Mitigating Bias in Generated Narratives - Ethical and Fair Narrative Generation - Misinformation and Fact Checking - Bias in LLM-generated narratives Narrative Applications - Narrative-focused Search in Text Collections - Narrative Summarization - Narrative Q&A - Multimodal Narrative Summarization - Multimodal Narrative-focused Search - Sentiment and Opinion Detection in Narratives - Social Media Narratives - Narrative Text Simplification - Narrative-based Text Anonymization - Personalization and Recommendation of Narratives - Storyline Visualization (including multimodal) and Narrative Structures ++ Submission Guidelines ++ We solicit the following types of contributions: -> Full papers (up to 8 pages + references): Original and high-quality unpublished contributions to the theory and practical aspects of the narrative extraction task. Full papers should introduce existing approaches, describe the methodology and the experiments conducted in detail. Negative result papers to highlight tested hypotheses that did not get the expected outcome are also welcomed. -> Short papers (up to 5 pages + references): Unpublished short papers describing work in progress; position papers introducing a new point of view, a research vision or a reasoned opinion on the workshop topics; and dissemination papers describing project ideas, ongoing research lines, case studies or summarized versions of previously published papers in high-quality conferences/journals that is worthwhile sharing with the Text2Story community, but where novelty is not a fundamental issue. -> Demos | Resource Papers (up to 5 pages + references): Unpublished papers presenting research/industrial demos; papers describing important resources (datasets or software packages) to the text2story community; Submissions will be refereed through a single-blind peer-review process by three reviewers with final acceptance decisions made by all the workshop organizers. The accepted papers will appear in the proceedings published at CEUR workshop proceedings (indexed in Scopus and DBLP) as long as they don't conflict with previous publication rights. ++ Workshop Format ++ Participants of accepted papers will be given 15 minutes for oral presentations. ++ Invited Speakers ++ Jochen L. Leidner, Coburg University of Applied Sciences, Germany Mirella Lapata, University of Edinburgh, Scotland ++ Organizing committee ++ Ricardo Campos (INESC TEC; University of Beira Interior, Covilhã, Portugal) Alípio M. Jorge (INESC TEC; University of Porto, Portugal) Adam Jatowt (University of Innsbruck, Austria) Sumit Bhatia (Media and Data Science Research Lab, Adobe) Marina Litvak (Shamoon Academic College of Engineering, Israel) ++ Proceedings Chair ++ João Paulo Cordeiro (NOVA Lincs & University of Beira Interior, Covilhã, Portugal) Conceição Rocha (INESC TEC, Portugal) ++ Web and Dissemination Chair ++ Hugo Sousa (INESC TEC & University of Porto, Portugal) Behrooz Mansouri (University of Maine, USA) ++ Program Committee ++ Ali Salehi (University at Buffalo) Arian Pasquali (Faktion AI) Andreas Spitz (University of Konstanz) Antoine Doucet (Université de La Rochelle) António Horta Branco (University of Lisbon) Bart Gajderowicz (University of Toronto) Behrooz Mansouri (Rochester Institute of Technology) Brenda Santana (Federal University of Rio Grande do Sul) Brucce dos Santos (Computational Intelligence Laboratory (LABIC) - ICMC/USP) Bruno Martins (IST & INESC-ID, University of Lisbon) David Semedo (Universidade NOVA de Lisboa) Dennis Aumiller (Cohere) Dhruv Gupta (Norwegian University of Science and Technology) Evelin Amorim (INESC TEC) Sérgio Matos (University of Aveiro) Florian Boudin (Nantes University) Henrique Lopes Cardoso (LIACC & University of Porto) Irina Rabaev (Shamoon College of Engineering) Ismail Altingovde (Middle East Technical University) Junbo Huang (University of Hamburg) Jakub Piskorski (Polish Academy of Sciences) João Paulo Cordeiro (Nova lincs & University of Beira Interior) Jin Zhao (Brandeis University) Luca Cagliero (Politecnico di Torino) Ludovic Moncla (INSA Lyon) Luis Filipe Cunha (INESC TEC & University of Minho) Marc Finlayson (Florida International University) Marc Spaniol (Université de Caen Normandie) Moreno La Quatra (Kore University of Enna) Nianwen Xue (Brandeis University) Nuno Guimarães (INESC TEC & University of Porto) Paulo Quaresma (Universidade de Évora) Paul Rayson (Lancaster University) Purificação Silvano (CLUP & University of Porto) Ross Purves (University of Zurich) Sérgio Nunes (INESC TEC & University of Porto) Sriharsh Bhyravajjula (University of Washington) Udo Kruschwitz (University of Regensburg) Valentina Bartalesi (ISTI-CNR, Italy) Yangyang Chen (Brandeis University) ++ Contacts ++ Website: https://text2story25.inesctec.pt For general inquiries regarding the workshop, reach the organizers at: text2story2025(a)easychair.org

1 0

2024

2023

2022