- Corpora - ELRA lists

1st Call for Papers: Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
by Manuela Sanguinetti 21 Feb '25

21 Feb '25

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ CLiC-it 2025 - Eleventh Italian Conference on Computational Linguistics ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 24 - 26 September 2025, Cagliari, Italy https://clic2025.unica.it/ Conference Announcement and First Call for Papers Over the years, CLiC-it has evolved into an important forum for the Italian community of researchers in Computational Linguistics (CL) and Natural Language Processing (NLP). CLiC-it aims to promote and disseminate high-quality, original research covering different aspects of automatic language processing, involving both written and spoken language. Furthermore, it seeks to showcase cutting-edge theoretical findings, experimental methodologies, technologies, and application perspectives. The spirit of the conference is inclusive. Recognizing the multifaceted nature of language phenomena and the need for interdisciplinary expertise, CLiC-it aims to bring together researchers from different fields including Computational Linguistics and Natural Language Processing, Linguistics, Cognitive Science, Machine Learning, Computer Science, Knowledge Representation, Information Retrieval, and Digital Humanities. CLiC-it welcomes contributions focusing on all languages, with a particular emphasis on Italian. CLiC-it 2025 will be held in Cagliari, from the 24th to the 26th of September. CLiC-it is organised by the Italian Association of Computational Linguistics (AILC -- http://www.ai-lc.it/). Conference topics ----------------------------- CLiC-it 2025 aims to have a broad technical program. Relevant topics for the conference include, but are not limited to (in alphabetical order): - Computational Historical Linguistics - Computational Social Science and Cultural Analytics - Dialogue and Interactive Systems - Discourse and Pragmatics - Ethics and NLP - Generation - Handwritten Text Recognition - Information Extraction - Information Retrieval and Text Mining - Interpretability and Analysis of Models for NLP - Language Grounding to Vision, Robotics and Beyond - Large Language Models - Linguistic Diversity - Linguistic Theories, Cognitive Modeling, and Psycholinguistics - Machine Learning for NLP - Machine Translation - Multilingualism and Cross-Lingual NLP - NLP Applications - NLP for the Humanities - Phonology, Morphology, and Word Segmentation - Pragmatics and Creativity - Question Answering - Resources and Evaluation - Semantics: Lexical, Sentence-level Semantics, Textual Inference, and Other Areas - Sentiment Analysis, Stylistic Analysis, and Argument Mining - Speech and Multimodality - Summarization - Syntax: Tagging, Chunking and Parsing Research Communications ---------------------------------- CLiC-it 2025 adopts a parallel submission policy for outstanding papers accepted in 2024 and 2025 by major publication venues, namely the major international CL conferences (workshops excluded) or international journals. These contributions can be submitted to CLiC-it 2025 as short research communications. Research communications will not be published in the conference proceedings, they serve primarily to promote the dissemination of high-quality research within the Italian CL community. Submitted research communications must be in the scope of the CLiC-it 2025 conference. The authors of papers that meet the above criteria are invited to submit a written (maximum) one-page abstract of the original paper, including the paper’s title and authors as well as a pointer to the original conference or journal where the paper was published. If needed, research communications will undergo a selection process overseen by the conference chairs. Since these papers have already been reviewed, the selection criteria will primarily consider their original publication venue. Priority will be granted to papers that align most closely with the conference program, ensuring a balanced representation across various conference topics. The research communication papers will be presented at the conference either orally or as a poster according to the number of submissions received. Paper Submission ----------------------- Submitted papers must describe substantial, original, completed, and unpublished work. Wherever appropriate, concrete evaluation and analysis should be included. CLiC-it 2025 allows for a multiple-submission policy. In case of acceptance of the paper in other venues, the authors must communicate this information to the CLiC-it 2025 Chairs as soon as possible. Papers may consist of at least six (6) and no more than eight (8) pages of content, and up to three (3) pages of references. Supplementary material is also allowed, but it should not exceed one (1) page in length. Authors are reminded that all relevant content should be included in the main text of the paper. Upon acceptance, final versions of papers will be given one additional page of content, so that reviewers’ comments can be taken into account. Papers will be evaluated according to the following criteria: - soundness of approach - relevance to computational linguistics - novelty and clarity of relation with related work - quality of presentation - quality of evaluation (if applicable) - verifiability and ability to replicate (if applicable) Papers can be either in English or Italian, with the abstract in English. Accepted papers will be published online and will be presented at the conference either orally or as a poster. Reviewing will NOT be blind, so there is no need to remove author information from manuscripts. The required template for CLiC-it submissions must be compatible with CEUR (https://ceur-ws.org/). You can download the conference-adapted version at the following links: LaTeX template https://clic2025.unica.it/wp-content/uploads/2025/02/CLiC-it-2025-template.… Word template https://clic2025.unica.it/wp-content/uploads/2025/02/CLiC_it_2025_template.… Should you encounter any issues with the compilation (as the CEUR template has historically presented some challenges and is not modifiable without risking exclusion from the proceedings), we provide a read-only Overleaf template: https://www.overleaf.com/read/hzyckyjzwhwb#06b27c This template can be accessed and cloned to help resolve any technical difficulties. Papers and research communications must be submitted through the START platform using the following link: https://softconf.com/p/clic-it2025 For research communications, the appropriate track should be selected. Awards --------- To acknowledge the contribution of young researchers to the field, the title of "best paper" will be awarded to outstanding papers, provided that a Master's or PhD student is the first author and presents the work at the conference. Recipients of this award will be invited to submit an extended version of their papers to the Italian Journal of Computational Linguistics (IJCoL). To recognise excellence in student research as well as promote awareness of our field, AILC is also conferring the “Emanuele Pianta” prize for the best Master Thesis (Laurea Magistrale) in Computational Linguistics submitted at an Italian University. The prize consists of 500 Euros plus free membership to AILC for one year and free registration to the upcoming CLiC-it. Important Dates --------------- - 09/06/2025: Paper submission deadline: regular papers and research communications - 21/07/2025: Notification to authors of reviewing/selection outcome - 04/08/2025: Camera ready version of accepted papers - 24-26/09/2025: CLiC-it 2025 Conference, Cagliari Conference Chairs ------ - Cristina Bosco (University of Torino) - Elisabetta Jezek (University of Pavia) - Marco Polignano (University of Bari) - Manuela Sanguinetti (University of Cagliari) Program Committee: ------ TBA Local Organizing Committee: ------ - Maurizio Atzori (DMI, University of Cagliari) - Andrea Loddo (DMI, University of Cagliari) - Alessandro Pani (DMI, University of Cagliari) - Alessandra Perniciano (DMI, University of Cagliari) - Luca Zedda (DMI, University of Cagliari) Web chairs: ------ - Maurizio Atzori - Andrea Loddo Further information ------------------- Conference website: https://clic2025.unica.it/ Mail: clicit2025cagliari(a)gmail.com

1 0

3rd CFP-GITT-2025 at MT Summit 2025
by bsavoldi＠fbk.eu 20 Feb '25

20 Feb '25

3rd CALL FOR PAPERS Third International Workshop on Gender-Inclusive Translation Technologies (GITT) at MT Summit 2025 23 June 2025, Geneva, Switzerland https://sites.google.com/tilburguniversity.edu/gitt2025 @gitt-workshop.bsky.social Important Dates (Time zone: Anywhere on Earth) Submission deadline: 10 March, 2025 Notification of Acceptance: 4 April, 2025 Camera Ready Copy due: 11 April, 2025 Workshop: 23 June, 2025 **Aim and scope** The Gender-Inclusive Translation Technologies Workshop (GITT) is set out to be the dedicated workshop that focuses on gender-inclusive language in translation and cross-lingual scenarios. The workshop aims to bring together researchers from diverse areas, including industry partners, MT practitioners, and language professionals. GITT aims to encourage multidisciplinary research that develops and interrogates both solutions and challenges for addressing bias and promoting gender inclusivity in MT and translation tools, including LMs applications for the translation task. **Topics** GITT invites technical as well as non-technical submissions, which consist of experimental, theoretical or methodological contributions. We explicitly welcome interdisciplinary submissions and submissions that focus on innovative, non-binary linguistic strategies and/or with sociolinguistically-informed perspectives. The topics of interest include, but are not limited to: - Models or methods for assessing and mitigating gender bias - New resources for inclusive language and gender translation (e.g., datasets, translation memories, dictionaries) - Social, cross-lingual, and ethical implications of gender bias - Qualitative and quantitative analyses on the potential limits of current approaches to gender bias in translation and MT, error taxonomies as well as best practices and guidelines - User-centric case studies on the impact of biased language and/or mitigating approaches which can include translators, post-editors, or monolingual MT users GITT is also open to other non-listed topics aligned with the scope of the workshop and works focusing on non-textual modalities (e.g., audiovisual translation) **Submission** We welcome four types of submissions, two archival and two non-archival. ARCHIVAL - Research papers: of at least 4 up to 10 pages (excluding references) - Extended Abstracts: up to 2 pages (including references) Accepted papers and extended abstracts consisting of novel work will be published online as proceedings in the ACL Anthology. NON-ARCHIVAL - Research Communications: up to 2 pages (including references). We include a parallel submission policy in the form of Research Communications for papers related to the topic of GITT that were accepted in other venues in 2024 and 2025. - Potluck Communications: short abstract up to 500 words (including references). Potluck Communications offer a space for anyone—especially students and early career researchers—to discuss bold new ideas for collaboration, brainstorm about ongoing work, and explore future research directions. The communications will not be included in the proceedings, but will serve to promote the dissemination of research aligned with the scope of the workshop. All submissions should adhere to the MT Summit 2025 guidelines and style templates (PDF, LaTeX, Word) and be uploaded on Easychair (https://easychair.org/my/conference?conf=mtsummit2025) **Workshop organizers** Janiça Hackenbuchner, University of Ghent Luisa Bentivogli, Fondazione Bruno Kessler Joke Daems, University of Ghent Chiara Manna, University of Tilburg Beatrice Savoldi, Fondazione Bruno Kessler Eva Vanmassenhove, University of Tilburg

1 0

Short-term research position in Computational Social Science
by Ines Rehbein 20 Feb '25

20 Feb '25

The Natural Language Processing and Information Retrieval Group at the University of Mannheim invites applications for a short-term position for ONE RESEARCHER (all genders welcome) IN COMPUTATIONAL POLITICAL SCIENCE / DATA SCIENCE / COMPUTATIONAL LINGUISTICS / STATISTICAL NLP The position is affiliated to the interdisciplinary research project Uncovering ideological frames in political discourses (UNCOVER) headed by Ines Rehbein [1] and Simone Ponzetto [2]. We are looking for a highly motivated candidate to conduct research in the area of NLP for political science. The candidate should have a strong interest and background in one or several of the following areas * computational political science * NLP / data science / text-as-data * computational linguistics / semantic text processing with a strong drive for interdisciplinary research and high proficiency in German. Candidates should have a Masters degree in Computational Linguistics, Natural Language Processing, Computer Science, Data Science, Political Science or related areas. The position will be located at the Data and Web Science Group (DWS) of the University of Mannheim, one of leading centers for Data Science in Germany (more information can be found at http://dws.informatik.uni-mannheim.de). Duration: The position will be available for 6 to 9 months and can be arranged as a full or part-time position. Salary range: according to German public scale TV-L 13. Applications can be made per e-mail (rehbein(a)uni-mannheim.de) and should include a short research statement, CV, copy of university degrees and transcripts. All documents should be e-mailed as a single PDF. All applications sent before March, 10, 2025 will receive full consideration. The position remains open until filled. Please feel free to contact Ines Rehbein (rehbein(a)uni-mannheim.de) for informal enquiries. The University of Mannheim is committed to increase the percentage of female scientists and encourages female applicants to apply. Among candidates of equal aptitude and qualifications, a person with disabilities will be given preference. Please note that threats to confidentiality and unauthorized access by third parties cannot be ruled out when communicating by unencrypted e-mail. The information on the collection of personal data from the data subject pursuant to Article 13 DS-GVO can be found on our homepage: https://www.uni-mannheim.de/universitaet/stellenanzeigen/datenschutz-bei-be…. [1] https://www.uni-mannheim.de/dws/people/researchers/postdoctoral-research-fe… [2] https://www.uni-mannheim.de/dws/people/professors/prof-dr-simone-paolo-ponz… -- Ines Rehbein Data and Web Science Group University of Mannheim, Germany

1 0

10th Annual Law & Corpus Linguistics Conference
by Brett Hashimoto 19 Feb '25

19 Feb '25

Dear Colleagues, The 10th annual Law & Corpus Linguistics Conference will be held on Friday, October 24, 2025 at Brigham Young University's J. Reuben Clark Law School in Provo, Utah. The keynote address will be delivered by Abbe Gluck, the Alfred M. Rankin Professor of Law and Faculty Director of the Solomon Center for Health Law and Policy at Yale Law School. Proposals are invited for individual papers and panels. We are open to submissions on a broad range of topics, including but not limited to: * applications of corpus linguistics to constitutional, statutory, contract, patent, trademark, probate, administrative, and criminal law in any state or nation; * philosophical, normative, and pragmatic commentary on the use of corpus linguistics in the law; * triangulation between corpus linguistics and other empirical methods in legal interpretation; * corpus-based analysis of legal discourse or topics; * best practices in corpus design and corpus linguistic methods in legal settings. The proposal deadline is May 15, 2025. Proposals should include an abstract of no more than 750 words and complete contact information for presenters. Please send proposals to byulawcorpus(a)law.byu.edu<mailto:byulawcorpus@law.byu.edu>. We hope you'll consider submitting a proposal! Sincerely, LCL 2025 Conference Organizing Committee (Tom Lee, Jesse Egbert, Brett Hashimoto, James Heilpern, James Phillips)

1 0

[Cfp] 2nd Call for Research & Innovation Papers at SEMANTiCS 2025
by Beyza Yaman 19 Feb '25

19 Feb '25

Second Call for Research & Innovation Papers SEMANTiCS 2025 EU 21st International Conference on Semantic Systems Vienna, Austria September 3 - 5, 2025 Important Dates: - *Abstract Submission Deadline: April 25 , 2025* - *Paper Submission Deadline: May 2, 2025* - *Notification of Acceptance: June 13, 2025* - *Camera-Ready Paper Deadline: July 04, 2025* *All deadlines are set for 11:59 pm, Anywhere On Earth time (UTC-12)* *Submissions will be through Easychair and the submission link will be provided soon.* Proceedings of SEMANTiCS 2025 EU will be made available *open access*. Research and Innovation Track The SEMANTiCS 2025 conference is excited to invite submissions for the Research and Innovation Track, welcoming groundbreaking research contributions, innovative solutions, and experimental studies relevant to the Semantic Web, Semantic Technologies, and AI-enabled semantics. We also encourage submissions at the intersections of these fields with other scientific and applied disciplines, fostering cross-disciplinary exchange and advancement. Papers should present original work that has not been published or is not under consideration elsewhere. All submissions must adhere to the submission guidelines, including reference formatting and any additional documentation as required. Each submission will undergo a rigorous review process, with at least three independent reviews, evaluating the novelty, technical quality, reproducibility, and practical relevance of the work. Topics of Interest SEMANTiCS 2025 calls for submissions of high-quality research papers across a broad spectrum of topics in Semantic Web, Semantic Technologies, and AI. We are particularly interested in new and emerging trends, especially where semantic technologies intersect with evolving fields such as large language models, explainable AI, and trustworthy data infrastructures. Topics of interest include, but are not limited to: - Web Semantics & Linked (Open) Data - Enterprise Knowledge Graphs, Graph Data Management - Machine Learning Techniques for/using Knowledge Graphs (e.g. reinforcement learning, deep learning, data mining and knowledge discovery) - Generative AI and Knowledge Graphs (e.g., Retrieval-Augmented Generation (RAG) with knowledge graph integration, generative model grounding) - Reasoning, Rules, and Policies on RAG - Knowledge Engineering and Management (e.g., knowledge acquisition, extraction, integration, and publication workflows) - Terminology, Thesaurus & Ontology Management, Ontology engineering - Web agents - Natural Language Processing for/using Knowledge Graphs (e.g. entity linking and resolution using target knowledge such as Wikidata and DBpedia, foundation models) - Crowdsourcing for/using Knowledge Graphs - Data Quality Management and Assurance - Mathematical and Logical Foundations of Knowledge-aware AI - Multimodal Knowledge Graphs (e.g., text, image, audio fusion in graph structures) - Semantic-Enhanced Data Science Pipelines and Processes - Semantics in Blockchain environments (e.g., traceability, decentralized knowledge representation) - Trust, Data Privacy, and Security with Semantic Technologies - Internet of Things (IoT), Stream Processing, and Temporal Data Management (e.g., real-time semantic processing and predictive analytics) - Conversational AI and Dialogue Systems powered by Knowledge Graphs - Provenance and Data Change Tracking (e.g., semantic versioning, data updates in distributed settings) - Semantic Interoperability (e.g., cross-domain standards, mapping frameworks, ontology alignment) - Linked Data storage, triple stores, graph databases - Robust, Scalable, and Fault-Tolerant Semantic Data Systems (e.g., distributed querying, optimization) - User Interfaces and Usability of Semantic Technologies (e.g., visualizations, intelligent user interaction) - Explainable and Interoperable AI - Decentralised and Federated Knowledge Graphs (e.g., federated querying, link traversal) Applied Semantic Technologies and AI in Real-World Scenarios, such as, but not limited to: - Biomedicine and Health (e.g., Knowledge Graphs for biomedical applications, AI-driven diagnostics, personalized health) - AI for Environmental and Climate Solutions (e.g., semantic modeling for environmental impact, biodiversity knowledge graphs) - Scientific Knowledge Graphs and Open Science (e.g., FAIR data principles, enhanced scholarly communication) - Semantic Technologies in GLAM (Galleries, Libraries, Archives, and Museums) - Knowledge Graphs and Hybrid AI for Industry 4.0/5.0 and Predictive Maintenance - Digital Humanities and Cultural Heritage Preservation - Legal Technology, AI Ethics, and Regulatory Compliance (e.g., AI and legal frameworks, semantic-enabled compliance with the EU AI Act) - Economics and Governance of Data Ecosystems (e.g., data marketplaces, semantic service interoperability, data policy) Submissions will be through Easychair. Stay tuned for the submission link. For *Submission Guidelines* and *Review and Evaluation Criteria* please head to the online call for papers: *https://2025-eu.semantics.cc/page/cfp_rev_rep* <https://2025-eu.semantics.cc/page/cfp_rev_rep>. We would highly appreciate it if you could disseminate this call within your network. *We look forward to receiving your contributions!* Research and Innovation Track Chairs Blerina Spahiu (University of Milano-Bicocca, IT) Mehdi Ali (Lamarr Institute & Fraunhofer IAIS, Germany) Kind Regards, On behalf of the organising committee. ========================= Dr. Beyza Yaman ADAPT Centre, Trinity College Dublin

1 0

Funded doctoral researcher positions in digital linguistics and NLP at Uni Turku, Finland
by Veronika Laippala 19 Feb '25

19 Feb '25

Dear all, University of Turku, Finland, invites applications for **fully funded doctoral researcher positions in digital linguistics and NLP, in the TurkuNLP research group**. The positions are part of the Human-Centric Artificial Intelligence for a Sustainable Future (HAIF) doctoral training programme, co-funded by the European Union’s Horizon Europe research and innovation programme’s Marie Skłodowska-Curie Actions (MSCA) (grant agreement No 101177564). Please find more information on the program and application procedure below! Best, Veronika Laippala HAIF is a doctoral programme for 25 doctoral researchers hosted by the University of Turku. HAIF unites research groups from the fields of computing, materials science, social sciences, law, humanities, and health sciences. HAIF doctoral researchers will conduct novel research under the guidance of scientifically distinguished and experienced supervisors. By connecting 11 research groups from 5 faculties, HAIF aims to create a cohesive, synergistic, and interdisciplinary research community. The global network of associated partners, representing various industries and third-sector organisations, in addition to universities and research institutes, are committed to supporting the HAIF doctoral training. This training features 4–6-month secondments during the years 2027–2029 and a variety of other educational activities. HAIF’s objective is to provide training that promotes the safe, secure, legally, and ethically sustainable use of AI, with an emphasis on humans as developers, users, and decision-subjects affected by the technology. In addition to individual and societal perspectives, HAIF’s research themes delve into the technological properties that shape interactions between humans and AI systems (e.g., transparency, interpretability, reliability, and accountability). HAIF doctoral researchers will be selected through a transparent, merit-based process with equity and inclusivity as cross-cutting priorities. The call for applications for the HAIF doctoral researcher positions is open until Friday, 28 February, at 15:00 (Helsinki/Europe). An eligible applicant is an early-stage researcher (no doctoral degree) who holds a Master’s degree in a relevant discipline. Based on the EU mobility rule, the applicant must not have resided in Finland for more than 12 months in the last 36 months. Read more about HAIF and find the guide for applicants on the website: https://haif.utu.fi/ Here is the direct link to the online application system: https://ats.talentadore.com/apply/25-doctoral-researcher-positions-in-msca-…

1 0

Call for application to KnitTogether'25 Research Summit
by Neele Falk 19 Feb '25

19 Feb '25

*THE 1ST EUROPEAN CL RESEARCH SUMMIT FOR JUNIOR RESEARCHERS* We invite junior researchers in computational linguistics and NLP to join us for an exciting week in the Swiss mountains! This call invites participants to apply for the summit by completing a non-binding registration form. Upon acceptance, participants will receive a final binding registration form. *Registration Form* Please register via the following registration form: https://forms.gle/kZpFnbGETwAXgxbWA <https://forms.gle/kZpFnbGETwAXgxbWA> *About KnitTogether:* Great research arises from amazing collaborations. However, establishing collaborations is challenging, and it depends on the context of the institution, the supervision, existing networks, and one’s personality. With *KnitTogether25*, we invite NLP researchers, particularly junior ones who work on *Bias in NLP and Its Societal Impacts,* to spend an exciting week in the Swiss mountains. In a growing community dealing with a topic that is gaining increasing societal influence and relevance, we want to join forces and exchange ideas. What can we learn from each other? In particular, but not limited to, we would like to explore: a) Which groups are under-/overrepresented or represented to their disadvantage? b) How can we incorporate such factors into modeling? c) How can we analyze them? We would like to hear the different perspectives of the participants: How do you relate your work to the topic? Using innovative and playful methods, we want to learn more about the work of our peers and thus get to know each other better /scientifically/. During a week full of hikes and other fun activities, the goal is to get to know each other without hurdles, draft ideas, and discuss research. We want to create a safe space where everyone can openly discuss their work and ideas without academic pressure. Program * Workshops * Peer-to-peer tutorials * Keynotes * Mentoring sessions * Brainstorming sessions * Social activities *Important Dates* * *February 28, 2025 (AoE)*: registration deadline * *May 5-10, 2025:* Retreat Date Workshop Location * Wildhaus, Switzerland *Workshop Fees* * *Registration fee:* ~ 60 Euros (includes accommodation and food, excludes travel costs). * Application for *additional travel subsidies* is possible. Website * https://knittogether.github.io/kt25/ <https://knittogether.github.io/kt25/> *Organizers* * Esra Dönmez (University of Stuttgart) * Neele Falk (University of Stuttgart) * Florian Schneider (University of Hamburg) * Andreas Waldis (TU Darmstadt, University of Lucerne) *Contact* For any questions, please contact the organizers at /knittogethernlp(a)gmail.com/ <mailto:knittogethernlp@gmail.com> Best Regards, KnitTogether25 Organizers *---------------------------------------------* *Sponsors* We would like to thank*IRIS*(Interchange Forum for Reflecting on Intelligent Systems),*HSLU*(University of Lucerne) and*GSCL*(German Society for Computational Linguistics and Language Technology) for sponsoring this event.

1 0

PROFE 2025 @ IberLEF 2025 - Call for Participation
by ALVARO RODRIGO YUSTE 18 Feb '25

18 Feb '25

<Apologies for cross-postings> ------------------------------------------------ Call for Participation PROFE 2025: Language Proficiency Evaluation IberLEF 2025 Shared Task https://nlp.uned.es/question-answering/profe2025 PROFE 2025 reuses the exams for Spanish proficiency evaluation developed by Instituto Cervantes over many years to evaluate human students. Therefore, automatic systems will be evaluated under the same conditions as humans were. Systems will receive a set of exercises with their corresponding instructions without specific training material. In this way we expect Transfer Learning approaches or the use of Generative Large Language Models. Subtasks PROFE 2025 has three subtasks, one per exercise type. Teams can participate in any combination of them. Each subtask contains several exercises of the same type. The subtasks are: 1. Multiple choice subtask: each exercise includes a text and a set of multiple-choice questions about the text where only one answer is correct. Given a multiple-choice question, systems must select the correct answer among the candidates. 2. Matching subtask: each exercise contains two sets of texts. Systems must find the text in the second set that best matches the first set. There is only one possible matching per text, but the first set can contain extra unnecessary texts. 3. Filling the gap subtask: each exercise contains a text with several gaps corresponding to textual fragments that have been removed and presented disorderly as options. Systems must determine the correct position for each fragment. There is only one correct text per gap, but there could be more candidates than gaps. The different exercises open research on how to approach them, adapting different prompts when using generative models. Dataset We will use the IC-UNED-RC-ES dataset created from real examinations at Instituto Cervantes. These exams were created by human experts to assess language proficiency in Spanish. We have already collected the exams and converted them to a digital format, which is ready to be used in the task. The dataset contains exams at different levels (from A1 to C2). The complete dataset contains 282 exams with 855 exercises. The total number of evaluation points are 6146 (among 16570 options) distributed by exercise type as: multiple-choice: 3544 responses matching: 2309 responses fill-the-gap: 293 responses In PROFE 2025 we plan to use around 50% of the exams, so the other 50% remains hidden for PROFE second edition. We intend not to distribute the gold standard to prevent overfitting in post-campaign experiments and data contamination in LLMs. Evaluation measures and baseline We will use traditional accuracy (proportion of correct answers) as the main evaluation measure. Systems will receive evaluation scores from two different perspectives: * At the question level, where correct answers are counted individually without grouping them. * At the exam level, where scores for each exam are considered. Each exam contains several exercises of different types. An exam is considered to be passed if an accuracy score (accounted as the proportion of correct answers) above 0.5 is reached. Then, the proportion of passed exams is given as a global score. This perspective will only apply to those teams participating in the three subtasks. More in detail, the exact evaluation per subtask is as follows: * Multiple choice subtask: we will measure accuracy as the proportion of questions correctly answered * Matching subtask: we will measure accuracy as the proportion of correct texts matched. * Fill in the gap subtask: We will measure accuracy as the proportion of correctly filled gaps. We will use accuracy as the evaluation measure because there is only one correct option among candidates and because it is the measure applied to humans doing the same exams. Thus, we can compare the performance of automatic systems and humans under the same conditions A preliminary baseline using ChatGPT obtains the following results for each exercise type (provided that different prompting can produce slightly different results): * Multiple choice accuracy: 0.64 * Filling the gap accuracy: 0.43 * Matching accuracy: 0.51 Schedule February 6, 2025 Registration opens March 10, 2025 Training data released April 28, 2025 Test set release May 9, 2025 Deadline for submitting runs May 14, 2025 Release of evaluation results June 3, 2025 Paper submission deadline Organizers Alvaro Rodrigo<https://www.uned.es/universidad/docentes/informatica/alvaro-rodrigo-yuste.h…>, UNED NLP & IR Group (Universidad Nacional de Educación a Distancia) Anselmo Peñas<https://www.uned.es/universidad/docentes/informatica/anselmo-penas-padilla.…>, UNED NLP & IR Group (Universidad Nacional de Educación a Distancia) Alberto Pérez<https://www.uned.es/universidad/docentes/informatica/alberto-perez-garcia-p…>, UNED NLP & IR Group (Universidad Nacional de Educación a Distancia) Sergio Moreno<https://www.uned.es/universidad/docentes/en/informatica/sergio-moreno-alvar…>, UNED NLP & IR Group (Universidad Nacional de Educación a Distancia) Javier Fruns, Instituto Cervantes Inés Soria, Instituto Cervantes Rodrigo Agerri<https://ragerri.github.io/>, HiTz (Universidad del País Vasco, UPV/EHU) AVISO LEGAL. Este mensaje puede contener información reservada y confidencial. Si usted no es el destinatario no está autorizado a copiar, reproducir o distribuir este mensaje ni su contenido. Si ha recibido este mensaje por error, le rogamos que lo notifique al remitente. Le informamos de que sus datos personales, que puedan constar en este mensaje, serán tratados en calidad de responsable de tratamiento por la UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA (UNED) c/ Bravo Murillo, 38, 28015-MADRID-, con la finalidad de mantener el contacto con usted. La base jurídica que legitima este tratamiento, será su consentimiento, el interés legítimo o la necesidad para gestionar una relación contractual o similar. En cualquier momento podrá ejercer sus derechos de acceso, rectificación, supresión, oposición, limitación al tratamiento o portabilidad de los datos, ante la UNED, Oficina de Protección de datos<https://www.uned.es/dpj>, o a través de la Sede electrónica<https://sede.uned.es/> de la Universidad. Para más información visite nuestra Política de Privacidad<https://descargas.uned.es/publico/pdf/Politica_privacidad_UNED.pdf>.

1 0

CIRCE Online Seminar 24/02/2025 - Dr. Francesca Gallina "Textbooks, ideologies and language education. An overview from different countries' teaching materials"
by Claudia Soria 18 Feb '25

18 Feb '25

🎓 CIRCE Seminar: Textbooks, ideologies and language education. An overview from different countries' teaching materials Dr. Francesca Gallina, University of Pisa, Italy Date: February 24, 2025 Time: 16:30 – 17:30 (CET) Venue: Online Attendees: Secondary school teachers, researchers, language instructors The CIRCE project <https://www.circe-project.eu> is pleased to announce the online seminar ‘Textbooks, ideologies and language education. An overview from different countries' teaching materials’ organized in collaboration with DFCLAM University of Siena, H2IOSC project and CNR ILC. Abstract: Textbooks play a pivotal role in language education, even in the era of internet and AI. For both learners and teachers, textbooks are something they use daily in the processes of learning and teaching, in the classroom or at home. According to Curdt-Christiansen and Weninger (2015) textbooks are sociocultural materials, they have the power to represent and position ideas, values and beliefs, namely they can legitimate an ideology, reflect a particular ideology and in this perspective, they can shape identity of learners. To explore textbooks as sociocultural products, we will analyze a sample of textbooks from different countries and focus on the following aspects: plurilingualism, theoretical approach, language activities, metalinguistic analysis and variation. Examples from textbooks will be presented and discussed. About the speaker: Francesca Gallina is Associate Professor of Educational Linguistics at the University of Pisa. She completed her PhD in Linguistics and didactic of Italian as L2 in 2009 with a dissertation on the development of the lexical competence of learners of Italian as a second language at the University for Foreigners of Siena. Her main research interest areas are: educational linguistics, L2 vocabulary acquisition, language contact and multilingualism, impact of language policies on the development of L2 teaching and learning processes. Her last publications are “Italiano di contatto e didattica plurilingue” (Cesati, 2021), “Osservare e valutare la competenza lessicale in italiano L2” (2022). The seminar will be hosted on the H2IOSC Training Environment to allow everyone interested to access a registration of the event. The seminar is free of charge, but participants must register. Further details and the link to register here: https://www.circe-project.eu/circe-online-seminar-series/ -- facebook <https://www.facebook.com/CNRsocialFB> twitter <https://twitter.com/CNRsocial_> instagram <https://www.instagram.com/cnrsocial/> linkedin <https://www.linkedin.com/company/283032> Claudia Soria CNR, ISTITUTO DI LINGUISTICA COMPUTAZIONALE "ANTONIO ZAMPOLLI" claudia.soria(a)ilc.cnr.it Tel. 0503153166 Via Giuseppe Moruzzi, 1, 56124 – Pisa www.ilc.cnr.it *www.cnr.it* <http://www.cnr.it/> Devolvi il 5×1000 al CNR CF 80054330586

1 0

Call-for-Participation: TalentCLEF Shared Task (CLEF) - Skill and Job Title Intelligence for Human Capital Management
by Luis Gasco 18 Feb '25

18 Feb '25

(* apologies for cross-posting *) Call for Participation TalentCLEF Shared Task (CLEF 2025) Skill and Job Title Intelligence for Human Capital Management https://talentclef.github.io/talentclef/ TalentCLEF is an initiative to advance Natural Language Processing (NLP) in Human Capital Management (HCM). It aims to create a public benchmark for model evaluation and promote collaboration to develop fair, multilingual, and flexible systems that improve Human Resources (HR) practices across different industries. Key information: - Web: https://talentclef.github.io/talentclef/ - Data: https://doi.org/10.5281/zenodo.14002665 - Registration: https://clef2025-labs-registration.dei.unipd.it/ Motivation In today’s rapidly changing socio-technological landscape, industries and workplaces are transforming quickly. Technological advancements, such as task automation and Artificial Intelligence (AI), are reshaping the labor market by creating new roles that demand specialized skills, often difficult to source. The rise of remote hiring, fueled by technological innovation, has expanded the labor market to a global and multilingual scale. Simultaneously, social progress is narrowing ethnic and gender disparities within companies, fostering more inclusive workplaces. Integrating Natural Language Processing (NLP) into Human Capital Management (HCM) enhances key areas such as sourcing and hiring, onboarding and training, strategic workforce planning, and career development. Despite these benefits, challenges persist in managing multilingual information, ensuring fair AI models, and developing systems flexible enough to work across industries. The TalentCLEF organizers expect that participation in the shared task will contribute to establishing a public benchmark for multilingual job title matching and skill prediction, enabling the evaluation and comparison of different approaches. This initiative will also provide a foundation for measuring gender bias in job-related NLP tasks and lay the groundwork for future benchmarks in other areas of Human Capital Management, fostering fairness, transparency, and adaptability in AI-driven workforce analysis. The inaugural TalentCLEF shared-task aims to tackle these challenges through two key tasks: - Task A - Multilingual Job Title Matching: Participants will develop systems to identify and rank job titles most similar to a given one. For each job title in a test set, systems must generate a ranked list of similar titles from a predefined knowledge base. Evaluation will be conducted in English, Spanish, German, and Chinese, covering both monolingual and cross-lingual (between English and the other languages) matching. - Task B - Job Title-Based Skill Prediction: This task focuses on retrieving relevant skills associated with a given job title. Participants will develop systems that predict and extract key skills based on job titles. The evaluation will be conducted in English. Schedule - 20th January 2025 - Training data available for Tasks A and B - 17th February 2025 – Start of Task A with the release of the development data - 17th March 2025 – Start of Task B with the release of the development data - 21st April 2025 – Test set release - 21st April - 5th May 2025 – Evaluation period of Task A and B - 7th May 2025 – Publication of Official Results - 30th May 2025 – Submission of CLEF 2025 Participant Working Notes (CEUR-WS) - 27th June 2025 - Notification of Acceptance for Participant Papers Publications and CLEF 2025 workshop Teams participating in TalentCLEF will be invited to submit a system description paper for the CLEF 2025 Working Notes proceedings, published on CEUR-WS. Additionally, they will have the opportunity to present a brief overview of their approach at the CLEF 2025 workshop, which will take place in Madrid, Spain, from September 9th to 12th, 2025. Main Organizers - Luis Gascó, Avature, Spain - Hermenegildo Fabregat, Avature, Spain - Laura García-Sardiña, Avature, Spain - Daniel Deniz Cerpa, Avature, Spain - Paula Estrella, Avature, Spain - Álvaro Rodrigo, Universidad Nacional de Educación a Distancia (UNED), Spain - Rabih Zbib, Avature, Spain Scientific Committee - Eneko Agirre - Full Professor of the University of the Basque Country UPV/EHU - ACL Fellow - David Camacho - Full Professor of the Technical University of Madrid (UPM) - Debora Nozza - Assistant Professor of Bocconi University - Jens-Joris Decorte - Lead AI Scientist at TechWolf - David Graus - Lead Data Scientist at Randstad Group - Mesutt Kayaa - Postdoctoral Researcher at Jobindex A/S and IT University Copenhagen - Jan Luts - Senior Data Scientist at NTT Data & ESCO - Elena Montiel-Ponsoda - Professor at the Technical University of Madrid (UPM) - AI4Labour project - Javier Huertas Tato - Assistant Professor of the Technical University of Madrid (UPM) - Patricia Martín Chozas - Postdoctoral Researcher at the Ontology Engineering Group (UPM) - AI4Labour project

1 0

2025

2024

2023

2022