GermEval: Call for Shared Task Proposals

We cordially invite proposals for the GermEval Shared Task 2025 co-located with Konvens 2025 in Hildesheim, Germany (September 9-12), https://konvens-2025.hs-hannover.de/ .

Background

GermEval is a series of shared task evaluation campaigns that focus on Natural Language Processing for the German language and has been running since 2014, traditionally co-located with Konvens.

Previous shared tasks

Previous shared tasks have been devoted to:

* Named entity recognition (2014) * Lexical Substitution (2015) * Aspect-based Sentiment in Social Media Customer Feedback (2016) * Offensive Language (2018, 2019) * Hierarchical classification of blurbs (2019) * Lemmatization of German web and social media texts (2019) * Text Complexity (2022) * Speaker Attribution (2023) * Sexism Detection in German Online News Fora (2024)

See also https://germeval.github.io/tasks/ for details.

Time schedule

Proposal submission deadline: December 15, 2024 Notification: December 20, 2024 Extended submission period January 4 - February 14, 2025 Extended notification: One week after submission Workshop: September 10, 2025

The early deadline facilitates a quick start of the organization of a shared task. Later submission is possible until February 14. We will try to review the proposal in that case within one week.

While fixing the exact timeline for the shared task is up to the task organizers, we propose the following tentative schedule:

Trial data ready: March 8, 2025 Training data ready: April 12, 2025 Test data ready: May 17, 2025 Evaluation start: June 16, 2025 Evaluation end: June 27, 2025 Paper submission due: July 11, 2025 Camera ready due: August 15, 2025

Submission guidelines

For GermEval proposals are invited for any shared task involving natural language processing in the context of the German language. For a detailed questionnaire to be submitted please see: https://gscl.org/germeval

Proposals should be submitted by e-mail to info.konvens2025@gscl.orgmailto:info.konvens2025@gscl.org, from the email of the contact person, with the subject "GermEval-2025 Shared Task Proposal". Proposals should make clear that a schedule similar to that suggested above can be implemented, especially for the preparation of resources (trial/training/development/test data sets). Proposals should be 2 to 3 pages long, in ACL - PDF format. We encourage proposers to include appendices with examples that help understanding the data and type of evaluation.

Proposals will be reviewed by the KONVENS Program Committee. Proposers might be contacted during the reviewing period to provide further information. Potential proposers should feel free to indicate the intention to submit by emailing info.konvens2025@gscl.orgmailto:info.konvens2025@gscl.org. We are also happy to answer your questions about the process, or to solicit early feedback for a proposal.

Proceedings

Peer-reviewed workshop papers can be published in the KONVENS 2025 Proceedings. A camera-ready version of all accepted papers should be available at latest on August 22, 2025.

Prof. Dr. Christian Wartena Hochschule Hannover Fakultät III - Medien, Information und Design Abt. Information und Kommunikation Lehrgebiet Sprach- und Wissensverarbeitung

Expo Plaza 12 30539 Hannover e-mail: christian.wartena@hs-hannover.demailto:christian.wartena@hs-hannover.de

[DATA-H-Logo_RGB_Unterzeile_klein]

Prof. Dr. Christian Wartena Hochschule Hannover Fakultät III - Medien, Information und Design Abt. Information und Kommunikation Lehrgebiet Sprach- und Wissensverarbeitung

Expo Plaza 12 30539 Hannover e-mail: christian.wartena@hs-hannover.demailto:christian.wartena@hs-hannover.de

[DATA-H-Logo_RGB_Unterzeile_klein]