=================================
IberLEF 2025 -- Call for Task Proposals
=================================
IberLEF (the Iberian Language Evaluation Forum) is a shared evaluation campaign of Natural Language Processing systems in Spanish and other Iberian languages, whose 2025 edition will be held as part of the 41th International Conference of the Spanish Society for Natural Language Processing (SEPLN). The 2025 edition of the SEPLN conference will take place in Zaragoza, Spain.
The goal of IberLEF is to encourage the research community to organize competitive text processing, understanding and generation tasks, with the aim of defining new research challenges and advancing the state of the art in Natural Language Processing challenges involving at least one of the following Iberian languages: Spanish, Portuguese, Catalan, Basque or Galician. Researchers and practitioners from all areas of Natural Language Processing and related communities are invited to submit task proposals that fit IberLEF goals by December 22, 2024.
Proposals must be submitted (as a pdf file) to iberlef@googlegroups.com, and should include the following fields:
-
Title of the task. -
Description of the task, highlighting: -
Relevance and novelty of the task, and the challenges involved. -
Evaluation measures, and other relevant methodological aspects. -
Expected target community, and actual or potential industrial takeup. -
Related evaluation activities, if any. -
Previous editions of the task, if any. If it has been organized previously, what the roadmap is and what the novelties for 2024 are. -
Linguistic resources to be gathered, created and/or reused. Please include as many details on data gathering, selection and annotation procedures as possible: sources and representativity, training/validation/test sizes, harvesting procedures, profile of annotators (experts, linguists, crowdworkers, etc.), multiple annotation policy, IPR issues, baselines, etc. -
Tentative schedule (note that camera-ready versions of the proceedings must be ready by July 3, 2025). -
Organization committee: full name and affiliation of the organizers, with a succinct description of their research interests, areas of expertise and experience organizing similar events. -
Funding, if available. -
Contact person. -
Any other relevant issues.
Task organizers duties
Note that organizers of accepted tasks are expected to:
-
Set up the evaluation exercise according to the submitted proposal. -
Promote the task within the target research community. -
Manage the submission and scientific evaluation of the system description papers of the corresponding systems submitted by the participants. The accepted papers will be published in the IberLEF proceedings. -
Prepare and submit an overview of the evaluation exercise. -
Present the results of the task at IberLEF 2025.
Task selection procedure
Each submitted proposal will be reviewed by members of the IberLEF steering and program committee, and decisions will be sent back to the task organizers by January 24, 2025.
Proceedings
IberLEF 2025 Proceedings including the description of the participating systems will be published at CEUR-WS.org. Task Overviews will be published in the SEPLN journal (http://www.sepln.org/en/journal, indexed in Clarivate ESCI (JCI: 0.21), CiteScore (Scopus): 2,9 and SJR: 0,421) in its September 2025 issue. Task Organizers are expected to notify participants the acceptance of their works by June 20, 2025, and send the camera ready task and system description papers for their task to IberLEF organizers by July 3, 2025.
Important dates
-
Task proposals due: December 22, 2024. -
Notification of acceptance: January 24, 2025. -
Final date for sending paper acceptance to task participants: June 20, 2025. -
Camera ready submissions due: July 3, 2025. -
IberLEF Workshop: September 2025.
IberLEF general chairs
Salud María Jiménez Zafra, SINAI, Universidad de Jaén (Spain)
Luis Chiruzzo, Universidad de la República (Uruguay)
José Ángel González Barba, Symanto Research (Spain)
Website
https://sites.google.com/view/iberlef-2025
Contact E-mail: iberlef@googlegroups.com
=================================
[image: Universidad de Jaén] http://www.uja.es/ *Salud María Jiménez Zafra* sjzafra@ujaen.es
Universidad de Jaén Grupo de Investigación SINAI http://sinai.ujaen.es/ | Departamento de Informática EPS Jaén, Edificio A3, Despacho 326 Campus Las Lagunillas s/n 23071 - Jaén | +34 953212992
[image: Universidad de Jaén] http://www.uja.es/