December 2024 - Corpora

1st Call for Participation: SustainEval 2025 - Understanding Sustainability Reports
by Jakob Prange 20 Dec '24

20 Dec '24

1st Call for Participation: SustainEval 2025 - Understanding Sustainability Reports We invite system and paper submissions for SustainEval 2025, a GermEval Shared Task co-located with KONVENS 2025 in Hildesheim, Germany, in September 2025. With this shared task, we aim to fuel research on automatic analysis and detection of greenwashing by challenging participants to build systems that categorize excerpts from German sustainability reports for (A) content class and (B) statement verifiability rating. Background: While corporate sustainability reporting aims to increase transparency, there is also a high incentive for companies to present themselves as environmentally friendly as possible, e.g. by selectively reporting only actions benefitting the environment and society, or by using vague optimistic language. This increasing tendency, known as "greenwashing" not only makes it difficult to tell apart concrete, verifiable actions from high-level plans and plain publicity, but can even blur the boundaries of the content reported in a given text passage according to a certain reporting criterion (e.g. actual greenhouse gas emissions vs. general tasks of some branch of the company). Call for Workshop Papers: We also invite submission of original papers about analyzing sustainability texts with NLP and other aspects of sustainability and NLP. Papers should describe original, unpublished work and can be technical contributions of empirical or theoretical nature, literature surveys or opinion pieces. More details on paper format and submission will be published soon in a separate call for papers. Important Dates All submission deadlines are 11:59 p.m. UTC-12:00 "anywhere on Earth."Training & Development Data Release:14th March 2025Registration Deadline / Start Evaluation Phase:10th June 2025Workshop Paper Submission Deadline (tentative):10th June 2025System/Results Submission Deadline:27th June 2025System Description Paper Submission Deadline:11th July 2025System papers will be reviewed within 10 days after the submission deadlineCamera-ready Deadline:15th Aug 2025Workshop & Final Presentation: 10th Sept 2025 For more information, submission formats, and trial data please refer to the shared task homepage: https://sustaineval.github.io/ If you have any questions, please feel free to contact us at sustaineval(a)gmail.com. Best regards and happy holidays, The Shared Task Organizers Jakob Prange, Universität Augsburg (contact for task-specific questions): jakob.prange(a)uni-a.de Charlott Jakob, TU Berlin (contact for organisational questions): c.jakob(a)tu-berlin.de Annemarie Friedrich, Universität Augsburg -- Dr. Jakob Prange (er/he) Akademischer Rat auf Zeit / Research Associate Chair for Natural Language Understanding & Digital Humanities (Prof. Friedrich) Faculty for Applied Informatics, University of Augsburg https://jakpra.github.io/

1 0

SemEval 2025 Task 10: Leaderboard Open
by Preslav Nakov 20 Dec '24

20 Dec '24

Dear Colleagues, We are excited to announce that the Leaderboard for SemEval 2025 Task 10: Multilingual Characterization and Extraction of Narratives from Online News is officially open! Task Overview The task focuses on analyzing multilingual news articles in two critical domains—Ukraine-Russia War and Climate Change—and is subdivided into three subtasks: 1. Entity Framing - Goal: Assign fine-grained roles (e.g., protagonist, antagonist, or innocent) to mentions of named entities in a news article. - Task Type: Multi-label, multi-class text-span classification. 2. Narrative Classification - Goal: Assign appropriate sub-narrative labels to a news article using a two-level taxonomy of narratives. - Task Type: Multi-label, multi-class document classification. 3. Narrative Extraction - Goal: Generate a free-text explanation (up to 80 words) for the dominant narrative in an article, grounded in evidence from the text. - Task Type: Text-to-text generation. This task provides an opportunity to push the boundaries of multilingual NLP and tackle challenges related to narrative understanding and extraction. Important Dates - Development Set Available: November 11, 2024 - Leaderboard Open: November 11, 2024 - Test Set Release: January, 2025 - Submission Deadline: January, 2025 (keep monitoring the website for precise dates) How to Participate 1. Visit the official task website: https://propaganda.math.unipd.it/semeval2025task10/ 2. Register your team to get access to the data and begin evaluating your models. 3. Submit your predictions to the leaderboard to compare with other participants. This is a great opportunity to contribute to cutting-edge research in multilingual narrative analysis and to engage with the SemEval community. We look forward to your participation! Best regards, The SemEval 2025 Task 10 Organizers

1 0

First Call for Papers - 23rd Workshop on Treebanks and Linguistic Theories (TLT 2025)
by Zinsmeister, Heike 20 Dec '24

20 Dec '24

We are excited to announce the 23rd International Workshop on Treebanks and Linguistic Theories (TLT 2025), which will bring together developers and users of linguistically annotated natural language corpora. The workshop is part of SyntaxFest 2025 and will be hosted by University of Ljubljana in Slovenia on August 26-29, 2025. Link to TLT 2025: https://www.korpuslab.uni-hamburg.de/en/tlt2025.html Link to SyntaxFest 2025: https://syntaxfest.github.io/ ----------------------------- SUBMISSION INFORMATION ----------------------------- TLT addresses all aspects of treebank design, development, and use. As ‘treebanks’ we consider any pairing of natural language data (spoken, signed, or written) with annotations of linguistic structure at various levels of analysis, including, e.g., morpho-phonology, syntax, semantics, and discourse. Annotations can take any form (including trees or general graphs), but they should be encoded in a way that enables computational processing. Reflections on the design of linguistic annotations, methodology studies, resource announcements or updates, annotation or conversion tool development, or reports on treebank usage including probing the leakage of treebanks into large language models are but some examples of the types of papers we anticipate for TLT. ----------------------------- IMPORTANT DATES ----------------------------- * First call for papers: December 2024 * Paper submission deadline: April 2025 * Notification of acceptance: June 2025 * Early bird registration: June 2025 * Conference dates: 26 to 29 August 2025 ----------------------------- TLT2025 WORKSHOP CHAIRS ----------------------------- * Sarah Jablotschkin, University of Hamburg * Sandra Kübler, Indiana University * Heike Zinsmeister, University of Hamburg Contact: tlt2025.gw(a)uni-hamburg.de Website: https://www.korpuslab.uni-hamburg.de/en/tlt2025.html

1 0

Exciting News: ISWC 2025 Heads to Nara, Japan – Save the Dates! 🎉
by Genet Asefa Gesese 20 Dec '24

20 Dec '24

Dear Semantic Web Community, We are thrilled to announce that the 24th International Semantic Web Conference (ISWC 2025) will take place in the historic and beautiful city of Nara, Japan, from November 2–6, 2025! Nara, renowned for its cultural treasures, breathtaking scenery, and warm hospitality, will provide the perfect backdrop for our vibrant community to gather, collaborate, and drive Semantic Web research and innovation to new heights. This year’s ISWC will be an in-person conference and promises to be an event to remember. Please keep an eye out for our official call for submissions, coming soon. We invite all researchers, practitioners, and industry specialists to contribute their insights and share their groundbreaking work with the global Semantic Web community. Stay tuned for updates on keynote speakers, workshops, tutorials, and unique local experiences that will make ISWC 2025 an unforgettable conference. As we embrace the holiday season, we want to take a moment to wish you all joyous and happy holidays. 🌟 Happy Holidays! 🌟 Mark your calendars now for ISWC 2025, and follow us on X (@iswc_conf <https://x.com/iswc_conf>) for the latest updates. We can’t wait to welcome you to Nara for an inspiring and impactful conference experience! 🎉 日本の奈良でお会いしましょう！ 🎉 Warm regards, The ISWC 2025 Organizing Committee -- *Dr.-Ing. **Genet Asefa Gesese* Head of Machine Learning Department (Abteilungsleitung Maschinelles Lernen) FIZ Karlsruhe – Leibniz Institute for Information Infrastructure ( *https://www.fiz-karlsruhe.de/en/bereiche/lebenslauf-und-publikationen-dr-ing-genet-asefa-gesese <https://www.fiz-karlsruhe.de/en/bereiche/lebenslauf-und-publikationen-dr-in…>* ) AND Karlsruhe Institute of Technology (KIT) *( https://www.aifb.kit.edu/web/Genet_Asefa_Gesese/en <https://www.aifb.kit.edu/web/Genet_Asefa_Gesese/en> )*

1 0

Call for papers: Queer in AI workshop at NAACL 2025
by Pranav A 20 Dec '24

20 Dec '24

Dear mailing list members, We are pleased to announce the Call for Papers for the Queer in AI Workshop, which will be held as an official workshop at NAACL 2025 in New Mexico, USA (April 29-May 4, 2025). Over the years, Queer in AI has grown so much that it has spawned its own research subfield. This called for us to convert our workshop into an official workshop at NAACL 2025, which means your work can now be published in the ACL Anthology. The workshop will be held in a hybrid format, allowing both in-person and virtual participation. WORKSHOP OVERVIEW The workshop aims to bring together researchers and practitioners working at the intersection of linguistics, queerness, and natural language processing. We provide a safe and inclusive space for presenting work, networking, and discussing critical issues in the field. TRACKS AND SUBMISSIONS We welcome submissions in three tracks: - Queer linguistics - Exploring language around gender and sexuality, including applications of queer theory to language research. - Queerness and NLP - Examining the intersection of NLP and queerness, from analyzing queer language patterns to investigating potential biases in NLP systems. - Queer activism and D&I - Addressing inclusivity challenges in NLP events and sharing strategies for queer advocacy in tech and academia. SUBMISSION OPTIONS: We provide two submission options: archival (if you want your papers published) and non-archival (if you just want to share or present your work). *Archival track*: Papers should be 4 pages (short) or 8 pages (long) in ACL format, with unlimited pages for references. All papers must use the official ACL style templates. Accepted papers will be published in the ACL Anthology. *Non-archival track*: In this track, you can submit creative work in the form of art, poetry, music, microblogs, TikToks, or videos; or you can submit your work-in-progress papers or abstracts. For this submit a PDF containing a summary/abstract of your work and a link to the actual content. Submissions in any language are welcome. IMPORTANT DATES: Archival submission deadline: January 30, 2025 Non-archival submission / Findings / ARR commitment deadline: February 20, 2025 Notification of acceptance: March 1, 2025 Camera-ready due: March 10, 2025 Mentorship is available for first-time authors. For more information or assistance, please contact: queer-in-nlp(a)googlegroups.com Website: https://www.queerinai.com/naacl-2025 Best regards, Queer in AI Workshop Organizers

1 0

Call for Participation: ICDAR 2025 Competition on Automatic Classification of Literary Epochs (CoLiE)
by Marina Litvak 20 Dec '24

20 Dec '24

We are pleased to announce the ICDAR 2025 Competition on Automatic Classification of Literary Epochs (CoLiE) <https://colie.pro/>, which aims to push the boundaries of temporal text analysis by challenging participants to develop state-of-the-art methods for dating literary texts. The competition focuses on leveraging natural language processing (NLP) and information retrieval (IR) techniques to predict the time periods in which texts were written.Overview The CoLiE competition offers two main tasks to address temporal classification and the understanding of historical texts: Task 1: Literary Epochs Classification <https://www.kaggle.com/competitions/icdar-2025-ColiE_Task1>This task focuses on classifying texts based on literary epochs and their subdivisions: - Sub-task 1.1: Classification of texts into six major literary epochs when the corresponding books were written: (1) Classicism (1660-1798), (2) Romanticism (1798-1837), (3) Victorian Literature (1837-1901), (4) Modernism (1900-1945), (5) Postmodernism (1945-2000), and (6) Contemporary (from 2000). - Sub-task 1.2: Classification of texts into particular epoch subdivisions: early (first quarter of the epoch), middle (middle half), and late (final quarter). These periods differ in length between epochs (due to the different lengths of the corresponding epochs). Also, the epochs of Classicism, Romanticism, Victorian Literature, Modernism, and Postmodernism epochs were divided into three periods, while the Contemporary epoch is divided into only two periods. Task 2: ChronoText Classification <https://www.kaggle.com/competitions/icdar-2025-ColiE_Task2>This task addresses temporal granularity by focusing on: - Sub-task 2.1: Identifying the century of origin for a given text. - Sub-task 2.2: Pinpointing the specific decade within that century when the text was composed. Participation We invite researchers, practitioners, and enthusiasts from IR and NLP communities to participate in this exciting competition. Important Dates: - December 17, 2024: The competition website is live and open to participants. Training and validation sets, together with their labels, are available. - April 1, 2025: Test dataset available. - April 8, 2025: Deadline for competition participants. - May 1, 2025: Submission of competition reports. - May 16, 2025: Camera-ready paper. - June 30, 2025: Communicate winners to chairs. - September 17-21, 2025: Presentation of results at the special session at the ICDAR conference. How to Participate: - Visit our website: <https://www.icdar2025.com/>https://colie.pro/ - Familiarize yourself with the tasks, competition rules, datasets, and evaluation metrics. - Submit your results through the Kaggle competition platform. Contact For any inquiries, please contact the competition organizers at colie2025.competition(a)gmail.com. We look forward to your participation and innovative contributions to the field of temporal text analysis! Organizers: Marina Litvak, SCE (marinal(a)ac.sce.ac.il) Irina Rabaev, SCE (irinar(a)ac.sce.ac.il) Ricardo Campos, University of Beira Interior, INESC TEC ( ricardo.campos(a)ubi.pt) Alípio Jorge, University of Porto, INESC TEC (amjorge(a)fc.up.pt) Adam Jatowt, University of Innsbruck (adam.jatowt(a)uibk.ac.at) Roza Bass, SCE (rozzaba(a)ac.sce.ac.il) Hugo Sousa, University of Porto, INESC TEC (hugo.sousa(a)fc.up.pt)

1 0

CFP: 2nd Int. Workshop on Natural Scientific Language Processing and Research Knowledge Graphs (NSLP 2025)
by Georg Rehm 20 Dec '24

20 Dec '24

2nd International Workshop on Natural Scientific Language Processing and Research Knowledge Graphs (NSLP 2025) 01 or 02 June 2025 (tbc) Portoroz, Slovenia (NSLP 2025 is co-located with ESWC 2025) https://nfdi4ds.github.io/nslp2025/ Scientific research is almost exclusively published in unstructured text formats, which are not readily machine-readable. While technological approaches can help to get this flood of scientific information and new knowledge under control, the development of such technologies is very complex in practice and hinders the creation of infrastructures and systems to track research and assist the scientific community with applications such as dedicated scientific search engines and recommender systems. The 2nd International Workshop on Natural Scientific Language Processing and Research Knowledge Graphs (NSLP) aims to bring together researchers working on the processing, analysis, transformation and exploitation of scientific language and research knowledge graphs including all relevant sub-topics. NSLP 2025 is a full-day workshop co-located with ESWC 2025 <https://2025.eswc-conferences.org/> to be held in Portoroz, Slovenia on 01 or 02 June 2025 (to be confirmed). The workshop features two shared tasks (see below) and a keynote speaker as well as presentations and posters of accepted papers. Topics of interest include, but are not limited to - Research/Scientific Knowledge Graphs (RKGs/SKGs) and other forms of structured scientific knowledge representation - Information Extraction for RKGs/SKGs - Question Answering over RKGs/SKGs - Other types of usage of RKGs/SKGs for downstream applications - Scientific LLMs: LLMs for Natural Scientific Language Processing (NSLP) - NSLP (monolingual, cross-lingual, multilingual) - Language Resources and Language Technologies for NSLP - Domain-specific Adaptation of NSLP Methods - Information Extraction from Scholarly Publications - Classification of Scholarly Publications (document collections, individual documents, parts of documents) - Summarisation of Scholarly Publications - Scholarly Information Retrieval and Scientific Search Engines - Digital Libraries of Scholarly Information - Bibliometrics and Scientometrics - Micropublications and Nanopublications Important dates - Paper submission deadline: 06 March 2025 - Notification of acceptance: 03 April 2025 - Camera-ready submission: 17 April 2025 - Workshop: 01 or 02 June 2025 (tbc) Submissions The NSLP 2025 workshop invites submissions of regular long papers, position papers, and short papers presenting negative results, in-progress projects, and demos. We especially encourage submissions from junior researchers and students from diverse backgrounds. - The workshop invites anonymous submissions of regular long papers (up to 15 pages without references and appendix) and short papers (up to 8 pages without references and appendix) presenting negative results, in-progress projects, and demos. In both categories, position papers can be submitted as well. - Authors are permitted to include an optional appendix of up to 2 pages. However, reviewers will not be mandated to review the appendix; all papers must be self-contained. - Reviewing will be performed double-blind. Reviewers will not actively try to identify the authors. - Submissions must be in PDF, formatted in the style of the Springer Publications format for Lecture Notes in Computer Science (LNCS). - The proceedings of this workshop will be published as an Open Access volume in the Springer series Lecture Notes in Artificial Intelligence (LNAI), fully sponsored by the NFDI4DS project. - At least one author per contribution must register for the conference for presentation as ESWC 2025 (including all workshops) is an in-person event. - We will not accept work that is under review or has already been published in or accepted for publication in a journal, another conference, or another workshop. - All submissions are done via EasyChair: https://easychair.org/conferences?conf=nslp2025 Shared tasks NSLP 2025 offers two shared tasks: - MESD: Metadata Extraction from Scholarly Documents - ReadMe2KG: Github ReadMe to Knowledge The NSLP 2025 website <https://nfdi4ds.github.io/nslp2025/> provides more information on the shared tasks. The relevant important dates for the two shared tasks will be announced in early January 2025. Confirmed keynote speaker - Michele Pasin, Digital Science, UK Organisers - Georg Rehm, DFKI & HU Berlin, Germany - Sonja Schimmler, TU Berlin & Fraunhofer FOKUS, Germany - Stefan Dietze, GESIS & HHU Düsseldorf, Germany - Natalia Manola, OpenAIRE, Greece Contact Georg Rehm <georg.rehm(a)dfki.de> -- *Prof. Dr. Georg Rehm <http://georg-re.hm/>* Principal Researcher and Research Fellow, DFKI Adjunct Professor, Humboldt-Universität zu Berlin DFKI GmbH <https://www.dfki.de/>, Alt-Moabit 91c, 10559 Berlin, Germany Phone: +49 30 23895-1833 – Fax: -1810 georg.rehm(a)dfki.de Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender), Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313

1 0

Masters scholarships in Language science
by Agnès CELLE 20 Dec '24

20 Dec '24

Funding for MA degrees in the language sciences is available at Université Paris Cité, through the Paris Graduate School of Linguistics. The Paris Graduate School of Linguistics (PGSL) is a Paris-area graduate program covering all areas of language science. It offers several comprehensive Master curricula integrating advanced study and research, in close connection with PhD programs as well as with the Empirical Foundations of Linguistics<http://www.labex-efl.com/> consortium. Research plays a central part in the program, and students also take elective courses to develop an interdisciplinary outlook. Prior knowledge of French is not required. For more details, please see https://paris-gsl.org/index.html Funding application opportunity: https://mobility.smarts-up.fr/ Deadline for grant applications : January 17th 2025 (Program start date: September 1st 2025) Note that funding is only available for non-French citizens and for students who do not hold a French university degree. Citizens of some countries (those requiring visas for study in France) must additionally and simultaneously apply to Campus France, as explained on the application portal. Agnès Celle Professeure de linguistique Directrice adjointe de CLILLAC-ARP UR 3967 Responsable du master de Linguistique anglaise UFR d'Etudes anglophones 8 place Paul Ricoeur, 75013 Paris Olympe de Gouges 753 +33(0)1 57 27 58 67 [Mail_LogoUPC154x50]

1 0

CFP: 5th Workshop on Scholarly Document Processing (SDP 2025) @ ACL 2025
by Georg Rehm 20 Dec '24

20 Dec '24

5th Workshop on Scholarly Document Processing (SDP 2025) @ ACL 2025 Call for Papers Dear colleagues – you are invited to participate in the 5th Workshop on Scholarly Document Processing (SDP 2025) to be held at ACL 2025 in Vienna, Austria. SDP 2025 will consist of a research track and five shared tasks. The call for research papers is described below, and more details can be found on our website, https://sdproc.org/2025/ <https://sdproc.org/2025/>. Papers must follow the ACL format and conform to the ACL 2025 Submission Guidelines. Paper submission has to be done through OpenReview: https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc> Website: https://sdproc.org/2025/ <https://sdproc.org/2025/> Submission site: https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc> X (Twitter): https://twitter.com/sdpworkshop <https://twitter.com/sdpworkshop> Shared tasks: https://sdproc.org/2025/sharedtasks.html <https://sdproc.org/2025/sharedtasks.html> Paper submission deadline: March 1 (Saturday), 2025 Call for Research Papers Scholarly literature is the chief means by which scientists and academics document and communicate their results and is therefore critical to the advancement of knowledge and improvement of human well-being. At the same time, this literature poses challenges to NLP uncommon in other genres, such as specialized language and high background knowledge requirements, long documents and strong structural conventions, multimodal presentation, citation relationships among documents, an emphasis on rational argumentation, and the frequent availability of detailed metadata and experimental data. These challenges necessitate the development of NLP methods and resources optimized for this domain. The Scholarly Document Processing (SDP) workshop provides a venue for discussing these challenges, bringing together stakeholders from different communities including computational linguistics, machine learning, text mining, information retrieval, digital libraries, scientometrics and others, to develop methods, tasks, and resources in support of these goals. This workshop builds on the success of prior workshops: SDP workshops held at EMNLP 2020, NAACL 2021, COLING 2022, and ACL 2024, and the 1st and 2nd SciNLP workshops held at AKBC 2020 and 2021. In addition to having broad appeal within the NLP community, we hope the SDP workshop will attract researchers from other relevant fields including meta-science, scientometrics, data mining, information retrieval, and digital libraries, bringing together these disparate communities within ACL. Topics of Interest We invite submissions from all communities demonstrating usage of and challenges associated with natural language processing, information retrieval, and data mining of scholarly and scientific documents. Relevant topics include (but are not limited to): Large Language Models (LLMs) for science Representation learning and language modeling Information extraction and NER Document understanding Summarization and generation Question-answering Discourse modeling/argumentation mining Network analysis Bibliometrics, scientometrics, and altmetrics Reproducibility and research integrity, including new challenges posed by generative AI Peer review tools, principles and technology Metadata and indexing Inclusion of datasets and computational resources Research infrastructures and digital libraries Increasing the representation in scholarly work of disadvantaged populations LLM-based interfaces to consume/produce scholarly documents Impact of scholarly communication on popular discourse Submission Information Authors are invited to submit full and short papers with unpublished, original work. Submissions will be subject to a double-blind peer-review process. Accepted papers will be presented by the authors at the workshop either as a talk or a poster. All accepted papers will be published in the workshop proceedings (proceedings from previous years can be found here:https://aclanthology.org/venues/sdp/ <https://aclanthology.org/venues/sdp/>), which will be published in the ACL Anthology. The submissions must be in PDF format and anonymized for review. All submissions must be written in English and follow the ACL 2025 formatting requirements: Long paper submissions: up to 8 pages of content, plus unlimited references. Short paper submissions: up to 4 pages of content, plus unlimited references. Submission Website: Paper submission has to be done through openreview: https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc> Final versions of accepted papers will be allowed 1 additional page of content so that reviewer comments can be taken into account. Important Dates (Main Research Track) First call for workshop papers: December 19, 2024 Second call for workshop papers: January 24, 2025 Third call for workshop papers: February 24, 2025 Paper submission deadline: March 1, 2025 Pre-reviewed (ARR) submission deadline: March 25, 2025 Notification of acceptance: April 17, 2025 Camera-ready paper due: May 16, 2025 Workshop dates: July 31 – August 1, 2025 Note: Shared task submission deadlines and other important dates to be announced. SDP 2024 Keynote Speakers We are excited to have several keynote speakers at SDP 2025. Tom Hope <https://tomhoper.github.io/>, Assistant Professor at Hebrew University of Jerusalem and Research Scientist at Allen Institute for AI. James A. Evans <https://sociology.uchicago.edu/directory/James-A-Evans>, Professor and Director of the Knowledge Lab at University of Chicago and External Professor at the Santa Fe Institute. TBA SDP 2025 Shared Tasks SDP 2025 will host five exciting shared tasks. More information about all shared tasks is provided on the workshop website:https://sdproc.org/2025/sharedtasks.html <https://sdproc.org/2025/sharedtasks.html> Detecting automatically generated scientific papers (DAGPap 25) A big problem with the ubiquity of Generative AI is that it has now become very easy to generate fake scientific papers. This can erode public trust in science and attack the foundations of science: are we standing on the shoulders of robots? The Detecting Automatically Generated Papers (DAGPAP) competition aims to encourage the development of robust, reliable AI-generated scientific text detection systems, utilizing a diverse dataset and varied machine learning models in a number of scientific domains. Organizers: Savvas Chamezopoulos, Dan Li, Anita de Waard (Elsevier). Contextualizing Scientific Figures and Tables (Context 25) Interpreting scientific claims in the context of empirical findings is a valuable practice, yet extremely time-consuming for researchers. Such interpretation requires identifying key results (often captured in tables and figures) that provide supporting evidence from research papers, and contextualizing these results with associated methodological details (e.g., measures, sample, etc.). During the previous version of this shared task in 2024, we released datasets to support the development of methods for automatic identification of key result figures or tables as well as additional grounding context to make claim interpretation more efficient. However, the released datasets contained tables and images already extracted from the scientific papers to allow participants to bypass PDF pre-processing issues. In Context 2025, given recent advances in multimodal LLMs, we plan to extend the difficulty of this task by requiring participants to identify key results from paper PDFs directly, and add a new sub-task on multi-hop reasoning over scientific evidence. Organizers: Joel Chan, Matthew Akamatsu, Aakanksha Naik Scientific Visual Question Answering (SciVQA) Scholarly articles convey valuable information not only through unstructured text but also via (semi-)structured figures such as charts and diagrams. Automatically interpreting the semantics of knowledge encoded in these figures can be beneficial for downstream tasks such as question answering (QA). In the SciVQA challenge, the participants will develop multimodal systems capable of efficiently processing both visual (i.e., addressing attributes such as colour, shape, size, etc.) and non-visual QA pairs based on images of scientific figures and their captions. Organizers: Ekaterina Borisova, Georg Rehm Scientific Fact-checking of Social Media Posts on Climate Change (ClimateCheck) The ClimateCheck shared task focuses on fact-checking claims from social media about climate change against peer-reviewed scholarly articles. Participants will retrieve relevant publications from a corpus of 400,000 climate research articles and classify each abstract as supporting, refuting, or not having enough information about the claim. Training data will include human-annotated claim-publication pairs, and the evaluation will combine nDCG@K and Bpref for retrieval and F1 score for classification. The task aims to develop models that link social media claims to scientific evidence, promoting informed and evidence-based discussions on climate change. Organizers: Raia Abu Ahmad, Georg Rehm Software Mention Detection in Scholarly Publications (SOMD 2) Software plays an essential role in computational research methods and is considered one of the crucial entities in scholarly documents. However, software mentions are not always cited in academic documents, resulting in various informal mentions of software across a paper. Automatic identification of such software mention contributes to the better understanding, accessibility, and reproducibility of the research work. In addition to the mention of software, to understand the research context, it is necessary to understand the purpose of a software mention and its attributes, making software mention detection a comprehensive task. We are extending our first iteration of the shared task SOMD 2024 <https://nfdi4ds.github.io/nslp2024/docs/somd_shared_task.html> with new challenges. In addition to information extraction techniques, our extended focus would be on Joint Named Entity and Relation Classification techniques. Organizers: Sharmila Upadhyaya, Frank Krueger, Stefan Dietze Organizing Committee Tirthankar Ghosal, Oak Ridge National Laboratory, USA Philipp Mayr, GESIS – Leibniz Institute for the Social Sciences, Germany Aakanksha Naik, Allen Institute for AI, USA Amanpreet Singh, Allen Institute for AI, USA Anita de Waard, Elsevier, Netherlands Dayne Freitag, SRI International, USA Georg Rehm, German Research Center for Artificial Intelligence (DFKI), Germany Sonja Schimmler, Fraunhofer FOKUS, Germany Dan Li, Elsevier, Netherlands -- <https://www.dfki.de/> Prof. Dr. Georg Rehm <http://georg-re.hm/> Principal Researcher and Research Fellow, DFKI Adjunct Professor, Humboldt-Universität zu Berlin DFKI GmbH <https://www.dfki.de/>, Alt-Moabit 91c, 10559 Berlin, Germany Phone: +49 30 23895-1833 – Fax: -1810 georg.rehm(a)dfki.de Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender), Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313

1 0

Call for participation in Web Survey on Data Bottlenecks in Supervised NLP
by Romberg, Julia 19 Dec '24

19 Dec '24

Dear list members, We invite you to participate in our web survey exploring how recent advancements in NLP, such as LLMs, have changed the need for labeled data in Supervised Machine Learning. Survey details: * Topic: Web survey on Data Annotation and Active Learning * Target group: Researchers and practitioners alike in the fields of NLP, Supervised Machine Learning, and Active Learning in particular (not required). * Duration: ~15 minutes * Deadline for participation: January 12, 2025 * Survey link: https://bildungsportal.sachsen.de/umfragen/limesurvey/index.php/538271 Why should I invest my time in this survey? * Make an impact: Participate in a community-effort and help to gain a better understanding of the current state and open issues on methods that are used to overcome a lack of labeled data. * Gain insights: Receive a report with key findings to incorporate these insights into research and development of new methods and technologies. Thank you for considering participating in our survey! If you have any questions or require additional information, please don't hesitate to contact us directly at activelearningsurvey2024(a)gmail.com<mailto:activeLearningSurvey2024@gmail.com>. If you know colleagues or peers who might be interested, we'd be grateful if you could forward this survey to them as well. Best regards, Julia Romberg (GESIS - Leibniz Institute for the Social Sciences, Germany) Christopher Schröder (Institut für Angewandte Informatik e. V., Germany) Julius Gonsior (TUD Dresden University of Technology) ------------------------------------------------------------------------ [gesis-logo-new-50-50] Leibniz Institute for the Social Sciences Julia Romberg Computational Social Science, Team Data Science Methods +49(221)47694-742

1 0

2024

2023

2022

Corpora December 2024