We are excited to share that the *15th European Summer University in
Digital Humanities (ESU-2025)* will take place from *July 22nd to August
1st, 2025, in Besançon, France*.
The local host will be /Université de Franche-Comté/, which will soon be
renamed /Université Marie et Louis Pasteur/.
Please reserve these dates in your calendar. More details will be
provided in January 2025.
Best regards,
Alexandra Cotoc and Alex Bia
ESU Steering Committee chairs
______________________________
Prof. Dr. phil. Elisabeth Burr
Universität Leipzig
Beethovenstr. 15
D-04107 Leipzig
https://home.uni-leipzig.de/burr/
1st Call for Participation: SustainEval 2025 - Understanding Sustainability Reports
We invite system and paper submissions for SustainEval 2025, a GermEval Shared Task co-located with KONVENS 2025 in Hildesheim, Germany, in September 2025.
With this shared task, we aim to fuel research on automatic analysis and detection of greenwashing by challenging participants to build systems that categorize excerpts from German sustainability reports for (A) content class and (B) statement verifiability rating.
Background:
While corporate sustainability reporting aims to increase transparency, there is also a high incentive for companies to present themselves as environmentally friendly as possible, e.g. by selectively reporting only actions benefitting the environment and society, or by using vague optimistic language. This increasing tendency, known as "greenwashing" not only makes it difficult to tell apart concrete, verifiable actions from high-level plans and plain publicity, but can even blur the boundaries of the content reported in a given text passage according to a certain reporting criterion (e.g. actual greenhouse gas emissions vs. general tasks of some branch of the company).
Call for Workshop Papers:
We also invite submission of original papers about analyzing sustainability texts with NLP and other aspects of sustainability and NLP. Papers should describe original, unpublished work and can be technical contributions of empirical or theoretical nature, literature surveys or opinion pieces. More details on paper format and submission will be published soon in a separate call for papers.
Important Dates
All submission deadlines are 11:59 p.m. UTC-12:00 "anywhere on Earth."Training & Development Data Release:14th March 2025Registration Deadline / Start Evaluation Phase:10th June 2025Workshop Paper Submission Deadline (tentative):10th June 2025System/Results Submission Deadline:27th June 2025System Description Paper Submission Deadline:11th July 2025System papers will be reviewed within 10 days after the submission deadlineCamera-ready Deadline:15th Aug 2025Workshop & Final Presentation: 10th Sept 2025
For more information, submission formats, and trial data please refer to the shared task homepage:
https://sustaineval.github.io/
If you have any questions, please feel free to contact us at sustaineval(a)gmail.com.
Best regards and happy holidays,
The Shared Task Organizers
Jakob Prange, Universität Augsburg (contact for task-specific questions): jakob.prange(a)uni-a.de
Charlott Jakob, TU Berlin (contact for organisational questions): c.jakob(a)tu-berlin.de
Annemarie Friedrich, Universität Augsburg
--
Dr. Jakob Prange (er/he)
Akademischer Rat auf Zeit / Research Associate
Chair for Natural Language Understanding & Digital Humanities (Prof. Friedrich)
Faculty for Applied Informatics, University of Augsburg
https://jakpra.github.io/
Dear Colleagues,
We are excited to announce that the Leaderboard for SemEval 2025 Task 10:
Multilingual Characterization and Extraction of Narratives from Online News
is officially open!
Task Overview
The task focuses on analyzing multilingual news articles in two critical
domains—Ukraine-Russia War and Climate Change—and is subdivided into three
subtasks:
1.
Entity Framing
-
Goal: Assign fine-grained roles (e.g., protagonist, antagonist, or
innocent) to mentions of named entities in a news article.
-
Task Type: Multi-label, multi-class text-span classification.
2.
Narrative Classification
-
Goal: Assign appropriate sub-narrative labels to a news article using
a two-level taxonomy of narratives.
-
Task Type: Multi-label, multi-class document classification.
3.
Narrative Extraction
-
Goal: Generate a free-text explanation (up to 80 words) for the
dominant narrative in an article, grounded in evidence from the text.
-
Task Type: Text-to-text generation.
This task provides an opportunity to push the boundaries of multilingual NLP
and tackle challenges related to narrative understanding and extraction.
Important Dates
-
Development Set Available: November 11, 2024
-
Leaderboard Open: November 11, 2024
-
Test Set Release: January, 2025
-
Submission Deadline: January, 2025 (keep monitoring the website for
precise dates)
How to Participate
1.
Visit the official task website:
https://propaganda.math.unipd.it/semeval2025task10/
2.
Register your team to get access to the data and begin evaluating your
models.
3.
Submit your predictions to the leaderboard to compare with other
participants.
This is a great opportunity to contribute to cutting-edge research in
multilingual
narrative analysis and to engage with the SemEval community.
We look forward to your participation!
Best regards,
The SemEval 2025 Task 10 Organizers
We are excited to announce the 23rd International Workshop on Treebanks and Linguistic Theories (TLT 2025), which will bring together developers and users of linguistically annotated natural language corpora. The workshop is part of SyntaxFest 2025 and will be hosted by University of Ljubljana in Slovenia on August 26-29, 2025.
Link to TLT 2025: https://www.korpuslab.uni-hamburg.de/en/tlt2025.html
Link to SyntaxFest 2025: https://syntaxfest.github.io/
-----------------------------
SUBMISSION INFORMATION
-----------------------------
TLT addresses all aspects of treebank design, development, and use. As ‘treebanks’ we consider any pairing of natural language data (spoken, signed, or written) with annotations of linguistic structure at various levels of analysis, including, e.g., morpho-phonology, syntax, semantics, and discourse. Annotations can take any form (including trees or general graphs), but they should be encoded in a way that enables computational processing. Reflections on the design of linguistic annotations, methodology studies, resource announcements or updates, annotation or conversion tool development, or reports on treebank usage including probing the leakage of treebanks into large language models are but some examples of the types of papers we anticipate for TLT.
-----------------------------
IMPORTANT DATES
-----------------------------
* First call for papers: December 2024
* Paper submission deadline: April 2025
* Notification of acceptance: June 2025
* Early bird registration: June 2025
* Conference dates: 26 to 29 August 2025
-----------------------------
TLT2025 WORKSHOP CHAIRS
-----------------------------
* Sarah Jablotschkin, University of Hamburg
* Sandra Kübler, Indiana University
* Heike Zinsmeister, University of Hamburg
Contact: tlt2025.gw(a)uni-hamburg.de
Website: https://www.korpuslab.uni-hamburg.de/en/tlt2025.html
Dear Semantic Web Community,
We are thrilled to announce that the 24th International Semantic Web
Conference (ISWC 2025) will take place in the historic and beautiful city
of Nara, Japan, from November 2–6, 2025!
Nara, renowned for its cultural treasures, breathtaking scenery, and warm
hospitality, will provide the perfect backdrop for our vibrant community to
gather, collaborate, and drive Semantic Web research and innovation to new
heights.
This year’s ISWC will be an in-person conference and promises to be an
event to remember. Please keep an eye out for our official call for
submissions, coming soon. We invite all researchers, practitioners, and
industry specialists to contribute their insights and share their
groundbreaking work with the global Semantic Web community.
Stay tuned for updates on keynote speakers, workshops, tutorials, and
unique local experiences that will make ISWC 2025 an unforgettable
conference.
As we embrace the holiday season, we want to take a moment to wish you all
joyous and happy holidays.
🌟 Happy Holidays! 🌟
Mark your calendars now for ISWC 2025, and follow us on X (@iswc_conf
<https://x.com/iswc_conf>) for the latest updates. We can’t wait to welcome
you to Nara for an inspiring and impactful conference experience!
🎉 日本の奈良でお会いしましょう! 🎉
Warm regards,
The ISWC 2025 Organizing Committee
--
*Dr.-Ing. **Genet Asefa Gesese*
Head of Machine Learning Department (Abteilungsleitung Maschinelles Lernen)
FIZ Karlsruhe – Leibniz Institute for Information Infrastructure
( *https://www.fiz-karlsruhe.de/en/bereiche/lebenslauf-und-publikationen-dr-ing-genet-asefa-gesese
<https://www.fiz-karlsruhe.de/en/bereiche/lebenslauf-und-publikationen-dr-in…>*
)
AND
Karlsruhe Institute of Technology (KIT)
*( https://www.aifb.kit.edu/web/Genet_Asefa_Gesese/en
<https://www.aifb.kit.edu/web/Genet_Asefa_Gesese/en> )*
Dear mailing list members,
We are pleased to announce the Call for Papers for the Queer in AI
Workshop, which will be held as an official workshop at NAACL 2025 in New
Mexico, USA (April 29-May 4, 2025).
Over the years, Queer in AI has grown so much that it has spawned its own
research subfield. This called for us to convert our workshop into an
official workshop at NAACL 2025, which means your work can now be published
in the ACL Anthology.
The workshop will be held in a hybrid format, allowing both in-person and
virtual participation.
WORKSHOP OVERVIEW
The workshop aims to bring together researchers and practitioners working
at the intersection of linguistics, queerness, and natural language
processing. We provide a safe and inclusive space for presenting work,
networking, and discussing critical issues in the field.
TRACKS AND SUBMISSIONS
We welcome submissions in three tracks:
- Queer linguistics - Exploring language around gender and sexuality,
including applications of queer theory to language research.
- Queerness and NLP - Examining the intersection of NLP and queerness,
from analyzing queer language patterns to investigating potential biases in
NLP systems.
- Queer activism and D&I - Addressing inclusivity challenges in NLP
events and sharing strategies for queer advocacy in tech and academia.
SUBMISSION OPTIONS:
We provide two submission options: archival (if you want your papers
published) and non-archival (if you just want to share or present your
work).
*Archival track*: Papers should be 4 pages (short) or 8 pages (long) in ACL
format, with unlimited pages for references. All papers must use the
official ACL style templates. Accepted papers will be published in the ACL
Anthology.
*Non-archival track*: In this track, you can submit creative work in the
form of art, poetry, music, microblogs, TikToks, or videos; or you can
submit your work-in-progress papers or abstracts. For this submit a PDF
containing a summary/abstract of your work and a link to the actual
content. Submissions in any language are welcome.
IMPORTANT DATES:
Archival submission deadline: January 30, 2025
Non-archival submission / Findings / ARR commitment deadline: February 20,
2025
Notification of acceptance: March 1, 2025
Camera-ready due: March 10, 2025
Mentorship is available for first-time authors. For more information or
assistance, please contact: queer-in-nlp(a)googlegroups.com
Website: https://www.queerinai.com/naacl-2025
Best regards,
Queer in AI Workshop Organizers
We are pleased to announce the ICDAR 2025 Competition on Automatic
Classification of Literary Epochs (CoLiE) <https://colie.pro/>, which aims
to push the boundaries of temporal text analysis by challenging
participants to develop state-of-the-art methods for dating literary texts.
The competition focuses on leveraging natural language processing (NLP) and
information retrieval (IR) techniques to predict the time periods in which
texts were written.Overview
The CoLiE competition offers two main tasks to address temporal
classification and the understanding of historical texts:
Task 1: Literary Epochs Classification
<https://www.kaggle.com/competitions/icdar-2025-ColiE_Task1>This task
focuses on classifying texts based on literary epochs and their
subdivisions:
-
Sub-task 1.1:
Classification of texts into six major literary epochs when the
corresponding books were written: (1) Classicism (1660-1798), (2)
Romanticism (1798-1837), (3) Victorian Literature (1837-1901), (4)
Modernism (1900-1945), (5) Postmodernism (1945-2000), and (6) Contemporary
(from 2000).
-
Sub-task 1.2:
Classification of texts into particular epoch subdivisions: early (first
quarter of the epoch), middle (middle half), and late (final quarter).
These periods differ in length between epochs (due to the different lengths
of the corresponding epochs). Also, the epochs of Classicism, Romanticism,
Victorian Literature, Modernism, and Postmodernism epochs were divided into
three periods, while the Contemporary epoch is divided into only two
periods.
Task 2: ChronoText Classification
<https://www.kaggle.com/competitions/icdar-2025-ColiE_Task2>This task
addresses temporal granularity by focusing on:
-
Sub-task 2.1: Identifying the century of origin for a given text.
-
Sub-task 2.2: Pinpointing the specific decade within that century when
the text was composed.
Participation
We invite researchers, practitioners, and enthusiasts from IR and NLP
communities to participate in this exciting competition.
Important Dates:
-
December 17, 2024: The competition website is live and open to
participants. Training and validation sets, together with their labels, are
available.
-
April 1, 2025: Test dataset available.
-
April 8, 2025: Deadline for competition participants.
-
May 1, 2025: Submission of competition reports.
-
May 16, 2025: Camera-ready paper.
-
June 30, 2025: Communicate winners to chairs.
-
September 17-21, 2025: Presentation of results at the special session at
the ICDAR conference.
How to Participate:
-
Visit our website: <https://www.icdar2025.com/>https://colie.pro/
-
Familiarize yourself with the tasks, competition rules, datasets, and
evaluation metrics.
-
Submit your results through the Kaggle competition platform.
Contact
For any inquiries, please contact the competition organizers at
colie2025.competition(a)gmail.com.
We look forward to your participation and innovative contributions to the
field of temporal text analysis!
Organizers:
Marina Litvak, SCE (marinal(a)ac.sce.ac.il)
Irina Rabaev, SCE (irinar(a)ac.sce.ac.il)
Ricardo Campos, University of Beira Interior, INESC TEC (
ricardo.campos(a)ubi.pt)
Alípio Jorge, University of Porto, INESC TEC (amjorge(a)fc.up.pt)
Adam Jatowt, University of Innsbruck (adam.jatowt(a)uibk.ac.at)
Roza Bass, SCE (rozzaba(a)ac.sce.ac.il)
Hugo Sousa, University of Porto, INESC TEC (hugo.sousa(a)fc.up.pt)
2nd International Workshop on Natural Scientific Language Processing and
Research Knowledge Graphs (NSLP 2025)
01 or 02 June 2025 (tbc)
Portoroz, Slovenia
(NSLP 2025 is co-located with ESWC 2025)
https://nfdi4ds.github.io/nslp2025/
Scientific research is almost exclusively published in unstructured text
formats, which are not readily machine-readable. While technological
approaches can help to get this flood of scientific information and new
knowledge under control, the development of such technologies is very
complex in practice and hinders the creation of infrastructures and systems
to track research and assist the scientific community with applications
such as dedicated scientific search engines and recommender systems. The
2nd International Workshop on Natural Scientific Language Processing and
Research Knowledge Graphs (NSLP) aims to bring together researchers working
on the processing, analysis, transformation and exploitation of scientific
language and research knowledge graphs including all relevant sub-topics.
NSLP 2025 is a full-day workshop co-located with ESWC 2025
<https://2025.eswc-conferences.org/> to be held in Portoroz, Slovenia on 01
or 02 June 2025 (to be confirmed). The workshop features two shared tasks
(see below) and a keynote speaker as well as presentations and posters of
accepted papers.
Topics of interest include, but are not limited to
-
Research/Scientific Knowledge Graphs (RKGs/SKGs) and other forms of
structured scientific knowledge representation
-
Information Extraction for RKGs/SKGs
-
Question Answering over RKGs/SKGs
-
Other types of usage of RKGs/SKGs for downstream applications
-
Scientific LLMs: LLMs for Natural Scientific Language Processing (NSLP)
-
NSLP (monolingual, cross-lingual, multilingual)
-
Language Resources and Language Technologies for NSLP
-
Domain-specific Adaptation of NSLP Methods
-
Information Extraction from Scholarly Publications
-
Classification of Scholarly Publications (document collections,
individual documents, parts of documents)
-
Summarisation of Scholarly Publications
-
Scholarly Information Retrieval and Scientific Search Engines
-
Digital Libraries of Scholarly Information
-
Bibliometrics and Scientometrics
-
Micropublications and Nanopublications
Important dates
-
Paper submission deadline: 06 March 2025
-
Notification of acceptance: 03 April 2025
-
Camera-ready submission: 17 April 2025
-
Workshop: 01 or 02 June 2025 (tbc)
Submissions
The NSLP 2025 workshop invites submissions of regular long papers, position
papers, and short papers presenting negative results, in-progress projects,
and demos. We especially encourage submissions from junior researchers and
students from diverse backgrounds.
-
The workshop invites anonymous submissions of regular long papers (up to
15 pages without references and appendix) and short papers (up to 8
pages without references and appendix) presenting negative results,
in-progress projects, and demos. In both categories, position papers can be
submitted as well.
-
Authors are permitted to include an optional appendix of up to 2 pages.
However, reviewers will not be mandated to review the appendix; all papers
must be self-contained.
-
Reviewing will be performed double-blind. Reviewers will not actively
try to identify the authors.
-
Submissions must be in PDF, formatted in the style of the Springer
Publications format for Lecture Notes in Computer Science (LNCS).
-
The proceedings of this workshop will be published as an Open Access
volume in the Springer series Lecture Notes in Artificial Intelligence
(LNAI), fully sponsored by the NFDI4DS project.
-
At least one author per contribution must register for the conference
for presentation as ESWC 2025 (including all workshops) is an in-person
event.
-
We will not accept work that is under review or has already been
published in or accepted for publication in a journal, another conference,
or another workshop.
-
All submissions are done via EasyChair:
https://easychair.org/conferences?conf=nslp2025
Shared tasks
NSLP 2025 offers two shared tasks:
-
MESD: Metadata Extraction from Scholarly Documents
-
ReadMe2KG: Github ReadMe to Knowledge
The NSLP 2025 website <https://nfdi4ds.github.io/nslp2025/> provides more
information on the shared tasks. The relevant important dates for the two
shared tasks will be announced in early January 2025.
Confirmed keynote speaker
-
Michele Pasin, Digital Science, UK
Organisers
-
Georg Rehm, DFKI & HU Berlin, Germany
-
Sonja Schimmler, TU Berlin & Fraunhofer FOKUS, Germany
-
Stefan Dietze, GESIS & HHU Düsseldorf, Germany
-
Natalia Manola, OpenAIRE, Greece
Contact
Georg Rehm <georg.rehm(a)dfki.de>
--
*Prof. Dr. Georg Rehm <http://georg-re.hm/>*
Principal Researcher and Research Fellow, DFKI
Adjunct Professor, Humboldt-Universität zu Berlin
DFKI GmbH <https://www.dfki.de/>, Alt-Moabit 91c, 10559 Berlin, Germany
Phone: +49 30 23895-1833 – Fax: -1810
georg.rehm(a)dfki.de
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern
Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender), Helmut Ditzer
Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan
Amtsgericht Kaiserslautern, HRB 2313
Funding for MA degrees in the language sciences is available at Université Paris Cité, through the Paris Graduate School of Linguistics.
The Paris Graduate School of Linguistics (PGSL) is a Paris-area graduate program covering all areas of language science.
It offers several comprehensive Master curricula integrating advanced study and research, in close connection with PhD programs as well as with the Empirical Foundations of Linguistics<http://www.labex-efl.com/> consortium.
Research plays a central part in the program, and students also take elective courses to develop an interdisciplinary outlook. Prior knowledge of French is not required.
For more details, please see https://paris-gsl.org/index.html
Funding application opportunity: https://mobility.smarts-up.fr/
Deadline for grant applications : January 17th 2025 (Program start date: September 1st 2025)
Note that funding is only available for non-French citizens and for students who do not hold a French university degree. Citizens of some countries (those requiring visas for study in France) must additionally and simultaneously apply to Campus France, as explained on the application portal.
Agnès Celle
Professeure de linguistique
Directrice adjointe de CLILLAC-ARP UR 3967
Responsable du master de Linguistique anglaise
UFR d'Etudes anglophones
8 place Paul Ricoeur, 75013 Paris
Olympe de Gouges 753
+33(0)1 57 27 58 67
[Mail_LogoUPC154x50]
5th Workshop on Scholarly Document Processing (SDP 2025) @ ACL 2025
Call for Papers
Dear colleagues – you are invited to participate in the 5th Workshop on Scholarly Document Processing (SDP 2025) to be held at ACL 2025 in Vienna, Austria. SDP 2025 will consist of a research track and five shared tasks. The call for research papers is described below, and more details can be found on our website, https://sdproc.org/2025/ <https://sdproc.org/2025/>.
Papers must follow the ACL format and conform to the ACL 2025 Submission Guidelines. Paper submission has to be done through OpenReview: https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc>
Website: https://sdproc.org/2025/ <https://sdproc.org/2025/>
Submission site: https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc>
X (Twitter): https://twitter.com/sdpworkshop <https://twitter.com/sdpworkshop>
Shared tasks: https://sdproc.org/2025/sharedtasks.html <https://sdproc.org/2025/sharedtasks.html>
Paper submission deadline: March 1 (Saturday), 2025
Call for Research Papers
Scholarly literature is the chief means by which scientists and academics document and communicate their results and is therefore critical to the advancement of knowledge and improvement of human well-being. At the same time, this literature poses challenges to NLP uncommon in other genres, such as specialized language and high background knowledge requirements, long documents and strong structural conventions, multimodal presentation, citation relationships among documents, an emphasis on rational argumentation, and the frequent availability of detailed metadata and experimental data. These challenges necessitate the development of NLP methods and resources optimized for this domain. The Scholarly Document Processing (SDP) workshop provides a venue for discussing these challenges, bringing together stakeholders from different communities including computational linguistics, machine learning, text mining, information retrieval, digital libraries, scientometrics and others, to develop methods, tasks, and resources in support of these goals.
This workshop builds on the success of prior workshops: SDP workshops held at EMNLP 2020, NAACL 2021, COLING 2022, and ACL 2024, and the 1st and 2nd SciNLP workshops held at AKBC 2020 and 2021. In addition to having broad appeal within the NLP community, we hope the SDP workshop will attract researchers from other relevant fields including meta-science, scientometrics, data mining, information retrieval, and digital libraries, bringing together these disparate communities within ACL.
Topics of Interest
We invite submissions from all communities demonstrating usage of and challenges associated with natural language processing, information retrieval, and data mining of scholarly and scientific documents. Relevant topics include (but are not limited to):
Large Language Models (LLMs) for science
Representation learning and language modeling
Information extraction and NER
Document understanding
Summarization and generation
Question-answering
Discourse modeling/argumentation mining
Network analysis
Bibliometrics, scientometrics, and altmetrics
Reproducibility and research integrity, including new challenges posed by generative AI
Peer review tools, principles and technology
Metadata and indexing
Inclusion of datasets and computational resources
Research infrastructures and digital libraries
Increasing the representation in scholarly work of disadvantaged populations
LLM-based interfaces to consume/produce scholarly documents
Impact of scholarly communication on popular discourse
Submission Information
Authors are invited to submit full and short papers with unpublished, original work. Submissions will be subject to a double-blind peer-review process. Accepted papers will be presented by the authors at the workshop either as a talk or a poster. All accepted papers will be published in the workshop proceedings (proceedings from previous years can be found here:https://aclanthology.org/venues/sdp/ <https://aclanthology.org/venues/sdp/>), which will be published in the ACL Anthology.
The submissions must be in PDF format and anonymized for review. All submissions must be written in English and follow the ACL 2025 formatting requirements:
Long paper submissions: up to 8 pages of content, plus unlimited references.
Short paper submissions: up to 4 pages of content, plus unlimited references.
Submission Website: Paper submission has to be done through openreview:
https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc>
Final versions of accepted papers will be allowed 1 additional page of content so that reviewer comments can be taken into account.
Important Dates (Main Research Track)
First call for workshop papers: December 19, 2024
Second call for workshop papers: January 24, 2025
Third call for workshop papers: February 24, 2025
Paper submission deadline: March 1, 2025
Pre-reviewed (ARR) submission deadline: March 25, 2025
Notification of acceptance: April 17, 2025
Camera-ready paper due: May 16, 2025
Workshop dates: July 31 – August 1, 2025
Note: Shared task submission deadlines and other important dates to be announced.
SDP 2024 Keynote Speakers
We are excited to have several keynote speakers at SDP 2025.
Tom Hope <https://tomhoper.github.io/>, Assistant Professor at Hebrew University of Jerusalem and Research Scientist at Allen Institute for AI.
James A. Evans <https://sociology.uchicago.edu/directory/James-A-Evans>, Professor and Director of the Knowledge Lab at University of Chicago and External Professor at the Santa Fe Institute.
TBA
SDP 2025 Shared Tasks
SDP 2025 will host five exciting shared tasks. More information about all shared tasks is provided on the workshop website:https://sdproc.org/2025/sharedtasks.html <https://sdproc.org/2025/sharedtasks.html>
Detecting automatically generated scientific papers (DAGPap 25)
A big problem with the ubiquity of Generative AI is that it has now become very easy to generate fake scientific papers. This can erode public trust in science and attack the foundations of science: are we standing on the shoulders of robots? The Detecting Automatically Generated Papers (DAGPAP) competition aims to encourage the development of robust, reliable AI-generated scientific text detection systems, utilizing a diverse dataset and varied machine learning models in a number of scientific domains.
Organizers: Savvas Chamezopoulos, Dan Li, Anita de Waard (Elsevier).
Contextualizing Scientific Figures and Tables (Context 25)
Interpreting scientific claims in the context of empirical findings is a valuable practice, yet extremely time-consuming for researchers. Such interpretation requires identifying key results (often captured in tables and figures) that provide supporting evidence from research papers, and contextualizing these results with associated methodological details (e.g., measures, sample, etc.). During the previous version of this shared task in 2024, we released datasets to support the development of methods for automatic identification of key result figures or tables as well as additional grounding context to make claim interpretation more efficient. However, the released datasets contained tables and images already extracted from the scientific papers to allow participants to bypass PDF pre-processing issues. In Context 2025, given recent advances in multimodal LLMs, we plan to extend the difficulty of this task by requiring participants to identify key results from paper PDFs directly, and add a new sub-task on multi-hop reasoning over scientific evidence.
Organizers: Joel Chan, Matthew Akamatsu, Aakanksha Naik
Scientific Visual Question Answering (SciVQA)
Scholarly articles convey valuable information not only through unstructured text but also via (semi-)structured figures such as charts and diagrams. Automatically interpreting the semantics of knowledge encoded in these figures can be beneficial for downstream tasks such as question answering (QA). In the SciVQA challenge, the participants will develop multimodal systems capable of efficiently processing both visual (i.e., addressing attributes such as colour, shape, size, etc.) and non-visual QA pairs based on images of scientific figures and their captions.
Organizers: Ekaterina Borisova, Georg Rehm
Scientific Fact-checking of Social Media Posts on Climate Change (ClimateCheck)
The ClimateCheck shared task focuses on fact-checking claims from social media about climate change against peer-reviewed scholarly articles. Participants will retrieve relevant publications from a corpus of 400,000 climate research articles and classify each abstract as supporting, refuting, or not having enough information about the claim. Training data will include human-annotated claim-publication pairs, and the evaluation will combine nDCG@K and Bpref for retrieval and F1 score for classification. The task aims to develop models that link social media claims to scientific evidence, promoting informed and evidence-based discussions on climate change.
Organizers: Raia Abu Ahmad, Georg Rehm
Software Mention Detection in Scholarly Publications (SOMD 2)
Software plays an essential role in computational research methods and is considered one of the crucial entities in scholarly documents. However, software mentions are not always cited in academic documents, resulting in various informal mentions of software across a paper. Automatic identification of such software mention contributes to the better understanding, accessibility, and reproducibility of the research work. In addition to the mention of software, to understand the research context, it is necessary to understand the purpose of a software mention and its attributes, making software mention detection a comprehensive task.
We are extending our first iteration of the shared task SOMD 2024 <https://nfdi4ds.github.io/nslp2024/docs/somd_shared_task.html> with new challenges. In addition to information extraction techniques, our extended focus would be on Joint Named Entity and Relation Classification techniques.
Organizers: Sharmila Upadhyaya, Frank Krueger, Stefan Dietze
Organizing Committee
Tirthankar Ghosal, Oak Ridge National Laboratory, USA
Philipp Mayr, GESIS – Leibniz Institute for the Social Sciences, Germany
Aakanksha Naik, Allen Institute for AI, USA
Amanpreet Singh, Allen Institute for AI, USA
Anita de Waard, Elsevier, Netherlands
Dayne Freitag, SRI International, USA
Georg Rehm, German Research Center for Artificial Intelligence (DFKI), Germany
Sonja Schimmler, Fraunhofer FOKUS, Germany
Dan Li, Elsevier, Netherlands
--
<https://www.dfki.de/>
Prof. Dr. Georg Rehm <http://georg-re.hm/>
Principal Researcher and Research Fellow, DFKI
Adjunct Professor, Humboldt-Universität zu Berlin
DFKI GmbH <https://www.dfki.de/>, Alt-Moabit 91c, 10559 Berlin, Germany
Phone: +49 30 23895-1833 – Fax: -1810
georg.rehm(a)dfki.de
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern
Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender), Helmut Ditzer
Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan
Amtsgericht Kaiserslautern, HRB 2313