FoRC 2025: Shared Task on Field of Research Classification of Scholarly Publications Hosted as part of the NSLP 2025 Workshop 1 or 2 June 2024 (tbc) Portoroz, Slovenia (co-located with ESWC 2025)
FoRC Shared Task: https://nfdi4ds.github.io/nslp2025/docs/forc_shared_task.html NSLP 2025 Workshop: https://nfdi4ds.github.io/nslp2025/ A core application of Natural Scientific Language Processing (NSLP) is classifying scientific articles for their respective field of research (FoR). The 2025 iteration of the FoRC shared task builds on the data developed for Subtask II of FoRC in 2024 https://nfdi4ds.github.io/nslp2024/docs/forc_shared_task.html, adding to it a weakly supervised dataset of over 40K ACL publications. Participants are asked to design classification systems based on FoRC4CL, a corpus of 1500 English scholarly articles in Computational Linguistics (CL), collected from the ACL Anthology (CC BY 4.0) and manually annotated according to a novel hierarchical taxonomy, Taxonomy4CL, which consists of 170 core CL (sub-)topics. In addition, over 40K weakly supervised publications are provided to supplement the corpus and potentially increase model capabilities. Metadata fields include ACL Anthology ID, title, abstract, author(s), URL to the full text, publisher, publication year and month, proceedings title, DOI, venue, and the full text of the respective article. Task Overview Given an article from the ACL Anthology and a taxonomy of NLP/CL sub-topics (Taxonomy4CL), predict the entities from the taxonomy that correspond to the main contributions of the article. As a highly unbalanced, multi-label, hierarchical classification problem, this task will be evaluated by computing micro, macro and weighted precison, recall, and F1-score. Codabench page for participation: https://www.codabench.org/competitions/5779
Important dates Training and testing data release: February 18, 2025 System submissions deadline: March 25, 2025 Paper submissions: March 27, 2025 Notification of acceptance: April 10, 2025 Camera-ready submission: April 17, 2025
We encourage and invite participation from junior researchers and students from diverse backgrounds. Participants are also encouraged to submit a paper describing their systems to the NSLP 2025 workshop. Organisers
Maria Francis (DFKI, Berlin, Germany & University of Trento, Italy) Raia Abu Ahmad (DFKI, Berlin, Germany) Ekaterina Borisova (DFKI, Berlin, Germany) Georg Rehm (DFKI, Berlin, Germany)