- Corpora - ELRA lists

IWCS International Conference on Computational Semantics: 1st CfP
by Kilian Evang 14 Feb '25

14 Feb '25

16th International Conference on Computational Semantics (IWCS) Heinrich Heine University Düsseldorf 22-24 September 2025 https://iwcs2025.github.io/ IWCS is a biennial conference on computational semantics. This year's edition is organized by Heinrich Heine University Düsseldorf. The conference is endorsed by SIGSEM, the ACL Special Interest Group on Computational Semantics. The aim of the IWCS conference is to bring together researchers interested in any aspects of the computation, annotation, extraction, representation and learning of meaning in natural language, whether this is from a lexical or structural semantic perspective. IWCS embraces both symbolic and machine learning approaches to computational semantics, and everything in between. The conference and workshops will take place 22-24 September 2025. The invited speakers of IWCS 2025 are: Oana-Maria Camburu (University College London) Alexander Koller (Saarland University) Denis Paperno (Utrecht University) We invite paper submissions in all areas of computational semantics, in other words all computational aspects of meaning of natural language within written, spoken, signed, or multi-modal communication. Submissions are invited on these closely related areas: design of meaning representations syntax-semantics interface representing and resolving semantic ambiguity shallow and deep semantic processing and reasoning hybrid symbolic and statistical approaches to semantics distributional semantics alternative approaches to compositional semantics inference methods for computational semantics recognising textual entailment learning by reading methodologies and practices for semantic annotation machine learning of semantic structures probabilistic computational semantics neural semantic parsing computing meaning with large language models computational aspects of lexical semantics semantics and ontologies semantic web and natural language processing semantic aspects of language generation generating from meaning representations semantic relations in discourse and dialogue semantics and pragmatics of dialogue acts multimodal and grounded approaches to computing meaning semantics-pragmatics interface applications of computational semantics SUBMISSION INFORMATION Two types of submission are solicited: long papers and short papers. Both types should be submitted no later than 06 June 2025 (anywhere on earth). Long papers should describe original research and must not exceed 8 pages. Short papers (typically system or project descriptions, or ongoing research) must not exceed 4 pages. Acknowledgments, references, a limitations section (optional), an ethics statement (optional), and a technical appendix (optional, not subject to reviewing) do not count towards the page limit. Accepted papers get an extra page in the camera-ready version and will be published in the conference proceedings in the ACL Anthology. For inclusion in the proceedings, at least one author must register to the conference and present the paper in person. Papers will be accepted either for oral presentation or for a poster presentation. Submissions should be fully anonymous to ensure double-blind reviewing. Style-files IWCS 2025 papers should be formatted following the common two-column structure as used by IWCS 2021 (borrowed from ACL 2021). Please use these specific style-files or the Overleaf template. Style files: https://iwcs2021.github.io/download/iwcs2021-templates.zip Overleaf template: https://www.overleaf.com/latex/templates/instructions-for-iwcs-2021-proceed… Submitting Papers should be submitted in PDF format. Submission link: https://openreview.net/group?id=IWCS/2025/Conference Please contact the program chairs if you have problems using OpenReview. No anonymity period IWCS 2025 does not have an anonymity period. However, we ask you to be reasonable and not publicly advertise your preprint during (or right before) review. Double submission policy Papers that have been or will be submitted to other meetings or publications must indicate this at submission time. Authors of papers accepted for presentation at IWCS 2025 must notify the program chairs by the camera-ready deadline as to whether the paper will be presented. All accepted papers must be presented at the conference to appear in the proceedings. We will not accept for publication or presentation papers that overlap significantly in content or results with papers that will be (or have been) published elsewhere. IMPORTANT DATES All dates are anywhere on earth. Paper submission: 06 June 2025 Notification of acceptance: 01 August 2025 Camera-ready due: 22 August 2025 IWCS conference: 22-24 September 2025 CONTACT Local Organizers Chen Long Rafael Ehren Kilian Evang Laura Kallmeyer Rainer Osswald Christian Wurm Deniz Ekin Yavaş iwcs2025-organizers(a)uni-duesseldorf.de Program Chairs Kilian Evang (Heinrich Heine University Düsseldorf) Laura Kallmeyer (Heinrich Heine University Düsseldorf) Sylvain Pogodalla (INRIA Nancy) iwcs2025-program-chairs(a)uni-duesseldorf.de

1 0

IWCS International Conference on Computational Semantics: 1st CfP
by Kilian Evang 14 Feb '25

14 Feb '25

16th International Conference on Computational Semantics (IWCS) Heinrich Heine University Düsseldorf 22-24 September 2025 https://iwcs2025.github.io/ IWCS is a biennial conference on computational semantics. This year's edition is organized by Heinrich Heine University Düsseldorf. The conference is endorsed by SIGSEM, the ACL Special Interest Group on Computational Semantics. The aim of the IWCS conference is to bring together researchers interested in any aspects of the computation, annotation, extraction, representation and learning of meaning in natural language, whether this is from a lexical or structural semantic perspective. IWCS embraces both symbolic and machine learning approaches to computational semantics, and everything in between. The conference and workshops will take place 22-24 September 2025. The invited speakers of IWCS 2025 are: Oana-Maria Camburu (University College London) Alexander Koller (Saarland University) Denis Paperno (Utrecht University) We invite paper submissions in all areas of computational semantics, in other words all computational aspects of meaning of natural language within written, spoken, signed, or multi-modal communication. Submissions are invited on these closely related areas: design of meaning representations syntax-semantics interface representing and resolving semantic ambiguity shallow and deep semantic processing and reasoning hybrid symbolic and statistical approaches to semantics distributional semantics alternative approaches to compositional semantics inference methods for computational semantics recognising textual entailment learning by reading methodologies and practices for semantic annotation machine learning of semantic structures probabilistic computational semantics neural semantic parsing computing meaning with large language models computational aspects of lexical semantics semantics and ontologies semantic web and natural language processing semantic aspects of language generation generating from meaning representations semantic relations in discourse and dialogue semantics and pragmatics of dialogue acts multimodal and grounded approaches to computing meaning semantics-pragmatics interface applications of computational semantics SUBMISSION INFORMATION Two types of submission are solicited: long papers and short papers. Both types should be submitted no later than 06 June 2025 (anywhere on earth). Long papers should describe original research and must not exceed 8 pages. Short papers (typically system or project descriptions, or ongoing research) must not exceed 4 pages. Acknowledgments, references, a limitations section (optional), an ethics statement (optional), and a technical appendix (optional, not subject to reviewing) do not count towards the page limit. Accepted papers get an extra page in the camera-ready version and will be published in the conference proceedings in the ACL Anthology. For inclusion in the proceedings, at least one author must register to the conference and present the paper in person. Papers will be accepted either for oral presentation or for a poster presentation. Submissions should be fully anonymous to ensure double-blind reviewing. Style-files IWCS 2025 papers should be formatted following the common two-column structure as used by IWCS 2021 (borrowed from ACL 2021). Please use these specific style-files or the Overleaf template. Style files: https://iwcs2021.github.io/download/iwcs2021-templates.zip Overleaf template: https://www.overleaf.com/latex/templates/instructions-for-iwcs-2021-proceed… Submitting Papers should be submitted in PDF format. Submission link: https://openreview.net/group?id=IWCS/2025/Conference Please contact the program chairs if you have problems using OpenReview. No anonymity period IWCS 2025 does not have an anonymity period. However, we ask you to be reasonable and not publicly advertise your preprint during (or right before) review. Double submission policy Papers that have been or will be submitted to other meetings or publications must indicate this at submission time. Authors of papers accepted for presentation at IWCS 2025 must notify the program chairs by the camera-ready deadline as to whether the paper will be presented. All accepted papers must be presented at the conference to appear in the proceedings. We will not accept for publication or presentation papers that overlap significantly in content or results with papers that will be (or have been) published elsewhere. IMPORTANT DATES All dates are anywhere on earth. Paper submission: 06 June 2025 Notification of acceptance: 01 August 2025 Camera-ready due: 22 August 2025 IWCS conference: 22-24 September 2025 CONTACT Local Organizers Chen Long Rafael Ehren Kilian Evang Laura Kallmeyer Rainer Osswald Christian Wurm Deniz Ekin Yavaş iwcs2025-organizers(a)uni-duesseldorf.de Program Chairs Kilian Evang (Heinrich Heine University Düsseldorf) Laura Kallmeyer (Heinrich Heine University Düsseldorf) Sylvain Pogodalla (INRIA Nancy) iwcs2025-program-chairs(a)uni-duesseldorf.de

1 0

[Cfp] 2nd Call for Research & Innovation Papers at SEMANTiCS 2025
by Kossi Amouzouvi 14 Feb '25

14 Feb '25

Second Call for Research & Innovation Papers SEMANTiCS 2025 EU 21st International Conference on Semantic Systems Vienna, Austria September 3 - 5, 2025 Important Dates: - *Abstract Submission Deadline: April 25 , 2025* - *Paper Submission Deadline: May 2, 2025* - *Notification of Acceptance: June 13, 2025* - *Camera-Ready Paper Deadline: July 04, 2025* *All deadlines are set for 11:59 pm, Anywhere On Earth time (UTC-12)* *Submissions will be through Easychair and the submission link will be provided soon.* Proceedings of SEMANTiCS 2025 EU will be made available *open access*. Research and Innovation Track The SEMANTiCS 2025 conference is excited to invite submissions for the Research and Innovation Track, welcoming groundbreaking research contributions, innovative solutions, and experimental studies relevant to the Semantic Web, Semantic Technologies, and AI-enabled semantics. We also encourage submissions at the intersections of these fields with other scientific and applied disciplines, fostering cross-disciplinary exchange and advancement. Papers should present original work that has not been published or is not under consideration elsewhere. All submissions must adhere to the submission guidelines, including reference formatting and any additional documentation as required. Each submission will undergo a rigorous review process, with at least three independent reviews, evaluating the novelty, technical quality, reproducibility, and practical relevance of the work. Topics of Interest SEMANTiCS 2025 calls for submissions of high-quality research papers across a broad spectrum of topics in Semantic Web, Semantic Technologies, and AI. We are particularly interested in new and emerging trends, especially where semantic technologies intersect with evolving fields such as large language models, explainable AI, and trustworthy data infrastructures. Topics of interest include, but are not limited to: - Web Semantics & Linked (Open) Data - Enterprise Knowledge Graphs, Graph Data Management - Machine Learning Techniques for/using Knowledge Graphs (e.g. reinforcement learning, deep learning, data mining and knowledge discovery) - Generative AI and Knowledge Graphs (e.g., Retrieval-Augmented Generation (RAG) with knowledge graph integration, generative model grounding) - Reasoning, Rules, and Policies on RAG - Knowledge Engineering and Management (e.g., knowledge acquisition, extraction, integration, and publication workflows) - Terminology, Thesaurus & Ontology Management, Ontology engineering - Web agents - Natural Language Processing for/using Knowledge Graphs (e.g. entity linking and resolution using target knowledge such as Wikidata and DBpedia, foundation models) - Crowdsourcing for/using Knowledge Graphs - Data Quality Management and Assurance - Mathematical and Logical Foundations of Knowledge-aware AI - Multimodal Knowledge Graphs (e.g., text, image, audio fusion in graph structures) - Semantic-Enhanced Data Science Pipelines and Processes - Semantics in Blockchain environments (e.g., traceability, decentralized knowledge representation) - Trust, Data Privacy, and Security with Semantic Technologies - Internet of Things (IoT), Stream Processing, and Temporal Data Management (e.g., real-time semantic processing and predictive analytics) - Conversational AI and Dialogue Systems powered by Knowledge Graphs - Provenance and Data Change Tracking (e.g., semantic versioning, data updates in distributed settings) - Semantic Interoperability (e.g., cross-domain standards, mapping frameworks, ontology alignment) - Linked Data storage, triple stores, graph databases - Robust, Scalable, and Fault-Tolerant Semantic Data Systems (e.g., distributed querying, optimization) - User Interfaces and Usability of Semantic Technologies (e.g., visualizations, intelligent user interaction) - Explainable and Interoperable AI - Decentralised and Federated Knowledge Graphs (e.g., federated querying, link traversal) Applied Semantic Technologies and AI in Real-World Scenarios, such as, but not limited to: - Biomedicine and Health (e.g., Knowledge Graphs for biomedical applications, AI-driven diagnostics, personalized health) - AI for Environmental and Climate Solutions (e.g., semantic modeling for environmental impact, biodiversity knowledge graphs) - Scientific Knowledge Graphs and Open Science (e.g., FAIR data principles, enhanced scholarly communication) - Semantic Technologies in GLAM (Galleries, Libraries, Archives, and Museums) - Knowledge Graphs and Hybrid AI for Industry 4.0/5.0 and Predictive Maintenance - Digital Humanities and Cultural Heritage Preservation - Legal Technology, AI Ethics, and Regulatory Compliance (e.g., AI and legal frameworks, semantic-enabled compliance with the EU AI Act) - Economics and Governance of Data Ecosystems (e.g., data marketplaces, semantic service interoperability, data policy) Submissions will be through Easychair. Stay tuned for the submission link. For *Submission Guidelines* and * Review and Evaluation Criteria* please head to the online call for papers: *https://2025-eu.semantics.cc/page/cfp_rev_rep* <https://2025-eu.semantics.cc/page/cfp_rev_rep>. We would highly appreciate it if you could disseminate this call within your network. *We look forward to receiving your contributions!* Research and Innovation Track Chairs Blerina Spahiu (University of Milano-Bicocca, IT) Mehdi Ali (Lamarr Institute & Fraunhofer IAIS, Germany) Kind Regards, On behalf of the organising committee. ========================= Dr. Kossi Amouzouvi ScaDS.AI Dresden/Leipzig, TU Dresden -- DISCLAIMER: The contents of this email and any attachments are confidential. They are intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and you are herewith notified that the contents are legally privileged and that you do not have permission to disclose the contents to anyone, make copies thereof, retain or distribute or act upon it by any means, electronically, digitally or in print. The views expressed in this communication may be of a personal nature and not be representative of AIMS-NEI and/or any of its Centres or Initiatives.

1 0

GermEval 2025 Shared Task on Candy Speech Detection: 2nd Call for Participation
by Michael Wiegand 14 Feb '25

14 Feb '25

apologies for cross-posting We are pleased to announce the *GermEval Shared Task on Candy Speech Detection („Flausch-Erkennung“)* This is the second call to participate in the shared task on candy speech detection („Flausch-Erkennung“). We invite everyone from academia and industry to participate in the shared task. The workshop discussing the results of this shared task is planned to be held in conjunction with the Conference on Natural Language Processing (KONVENS) in September 2025. *Introduction* Numerous methods have been developed for detecting and censoring negative speech (e.g., hate speech or offensive or harmful language) on social media platforms. However, there is much less focus on identifying and promoting positive supportive discourse in online communities. Our shared task aims to address this gap and encourage researchers to focus on such positive expressions. The task is to identify expressions of candy speech (Flausch) in online posts (YouTube comments). We define candy speech as expression of positive attitudes on social media toward individuals or their output (videos, comments, etc.). The purpose of candy speech is to encourage, cheer up, support and empower others. It can be viewed as the counterpart to hate speech, as it also aims to influence the self-image of the target person or group, but in a positive way. *Data* We will provide the participants with annotated training (and development) and unlabeled test datasets containing complete written, German language comment threads under YouTube videos posted by different content creators. The content creators and communities vary in topic, style, age group, etc. The training and test datasets do not overlap in terms of YouTube videos. Furthermore, the test dataset mostly contains (comments on) videos from content creators that are different from those in the training dataset. The communities commenting on these videos can therefore be expected to differ. *Task Details* Candy speech detection is the task of identifying the presence of candy speech (at the span level) in a given YouTube comment and classifying each expression in one of the predefined categories. This shared task focuses on German speaking YouTube communities. Participants will be provided with a dataset of YouTube comments manually annotated for different types of candy speech expressions. We offer the following two subtasks. Participants in this year's shared task may choose to participate in either subtask: Subtask 1: Coarse-Grained Classification The goal of this subtask is to identify whether the given comment contains candy speech ("Flausch") or not. The dataset is manually annotated for the presence of candy speech. Subtask 2: Fine-Grained Classification The goal of this subtask is to identify the span of each candy speech expression in a given text and classify it in one of the predefined categories. The dataset is manually annotated for 10 different types of candy speech expressions, such as “positive feedback”, “compliment”, “group membership” etc. More details on the subtasks (including examples) can be found at the website of the shared task (see link below). *Important dates* Trial data available: February 15, 2025 Training data available: March 3, 2025 Test data available: May 17, 2025 Evaluation start: June 16, 2025 Evaluation end: June 27, 2025 Paper submission due: July 11, 2025 Camera ready due: August 15, 2025 GermEval workshop: September 8 or 12, 2025 (co-located with KONVENS) *Website* https://yuliacl.github.io/GermEval2025-Flausch-Erkennung/ *GermEval* GermEval is a series of shared task evaluation campaigns that focus on Natural Language Processing for the German language. GermEval has been conducted regularly since 2014 in co-location with KONVENS/GSCL conferences: https://germeval.github.io/tasks/ *contact email* Please send any enquiry to the following email address: germeval-2025-candy-speech(a)ruhr-uni-bochum.de Best regards, Yulia Clausen, Ruhr-Universität Bochum, Germany Tatjana Scheffler, Ruhr-Universität Bochum, Germany Michael Wiegand, Universität Wien, Austria

1 0

Funded PhD studentship in the ethical implications of Natural Language Processing
by z＠zeerak.org 13 Feb '25

13 Feb '25

[Apologies for cross-posting] Dear all, I am happy to announce that I’m looking for a fully funded PhD student to join me at the University of Edinburgh to work on topics around the ethics of NLP and ethical NLP methods. You can find more information below, but please don’t hesitate to reach out to me if you have any questions! Zee PhD Studentship Opportunity Examining the ethical implications of natural language processing The Edinburgh Futures Institute’s Centre for Technomoral Futures and the School of Informatics are delighted to invite applications for this PhD studentship, funded by Baillie Gifford, to begin in the academic year 2025/2026. This studentship, which is open to UK, EU and international applicants, will support rigorous interdisciplinary PhD research into the ethical challenges posed by the growing use of natural language processing and artificial intelligence. Application Deadline: 15 March 2025 Supervisors: * Dr Zee Talat<https://www.technomoralfutures.uk/our-academic-staff-database/zeerak-talat>, School of Informatics * Secondary supervisor, to be confirmed The Project: The aim of this project is to perform research in natural language processing (NLP) towards identifying and exploring methods for the ethical development of NLP tools. Given the increased uptake in the use and proliferation of NLP technologies, questions surrounding the ethical and responsible development of such tools are of greater urgency. To this end, this project will seek to examine the current ecosystems and practices for the development of language technologies, proactively develop technologies for examining NLP tools and their social ramifications, or design NLP technologies that encourage ethical practices. Through these areas, the project seeks to identify the ethical challenges faced by NLP and approaches to address them. For example, the project could: * Investigate how NLP and machine learning contributes to inequities in society * Show how end-users of NLP technologies can benefit from personalisation and privacy preservation methods * Investigate why current methods for addressing social biases in NLP and machine learning models fall short, and identify remedies for such shortcomings * Examine NLP and machine learning literature for the values that underpin research in the field The project will consider how NLP and machine learning are currently falling short in engaging with ethical development practices (such as those suggested in the indicative list above) and examine how such practices can be improved for the benefit of end-users and society more broadly. The project will make explicit the shortcomings of current methods in machine learning and research in the field of fairness and ethics of NLP and machine learning, and propose social, infrastructural, or technical mechanisms that can limit the harmful ramifications of applying current methods in NLP and machine learning in social contexts. It will contribute to the discourse on ethics and fairness in NLP and machine learning by considering in detail the promises made by AI-related fields, and how and why they are not met. See more information here: https://informatics.ed.ac.uk/study-with-us/our-degrees/postgraduate-researc…

1 0

Job opening: Associate Professor in Intercultural Communication
by Gisle Andersen 13 Feb '25

13 Feb '25

Apologies for cross-postings The Norwegian School of Economics (NHH) in Bergen, Norway, invites applicants for a position as Associate Professor (førsteamanuensis) in Intercultural Communication at the Department of Professional and Intercultural Communication. The position requires a PhD in intercultural communication, business communication or linguistics with a track record of research within communication in the workplace. The department's research and education profiles reflect NHH's objectives and are focused on modern professional communication in a broad sense within NHH's subject areas. The department has an active research environment in professional and intercultural communication, and its research profile encompasses terminology, corpora and language resources, specialised translation, intercultural communication and discourse analysis. The person appointed will contribute to strengthening research, teaching and dissemination in intercultural communication with an aspiration to be in the forefront of the field. We are seeking candidates who demonstrate high research potential and have a solid publication record relevant to the department's research profile. It is expected that the candidate has research experience in intercultural business communication. Applicants are requested to outline relevant research ideas/projects in their application. Please see the full advertisement on JobbNorge: https://www.jobbnorge.no/en/available-jobs/job/274936/associate-professor-i… Kind regards Gisle Andersen

1 0

Interspeech 2025 - Call for Show and Tell
by Grzegorz Chrupała 13 Feb '25

13 Feb '25

Submission deadline: 2 April 2025 Acceptance/rejection notification: 26 April 2025 Final paper and video deadline: 21 May 2025 Interspeech is the world’s largest and most comprehensive conference focused on the science and technology of spoken language processing. In addition to the regular paper and special session submissions, Interspeech organizes Show and Tell demonstrations, where participants are given the opportunity to present engaging and interactive research or engineering demonstrations to conference attendees. The demonstrations should showcase fundamental research and innovations in areas such as speech communication, production, perception, acquisition, or speech and language technologies. The theme of Interspeech 2025 is ‘Fair and Inclusive Speech Science and Technology’, allowing demonstration of innovative approaches to making speech technologies more accessible and equitable. Contributions must be relevant to Interspeech areas of interest and may also relate to the Interspeech theme. Show and Tell demonstrations should have an interactive component, which goes beyond demonstrating simple simulated graphs or presenting slides or a video on a computer. Any suggestions, as well as any questions, can be submitted to the Show and Tell Chairs: Aki Kunikoshi and Tanvina Patel at showandtell(a)interspeech2025.org Submission Guidelines Submissions must consist of: • a paper, no more than two pages in length (including references), in Interspeech 2025 paper kit format. • a video, describing visually to the reviewers what participants can expect to see during and how they will benefit from attending the demonstration. Show and Tell contributions may present mathematical and algorithmic results, but the primary focus should be on demonstrating a technological innovation or implementation. These contributions may relate to an already published paper or a submitted paper at Interspeech 2025. The paper submissions will be blind, and author details should not be included. Submissions will be assessed on criteria such as the quality of the short paper, the innovation of the research or system presented, and the overall clarity and impact of the demonstration. Additionally, it is required that the demonstration has not been presented as is at a recent Interspeech conference, ensuring the novelty of the contributions. For accepted submissions, participants must provide a camera-ready version of the paper to be included in the conference proceedings. Additionally, a final version of the video must be submitted by the camera ready deadline, which will be made publicly available. The demonstrations will be conducted in person at the conference and at least one presenter will need to register at Interspeech 2025 to present the demonstration at the Show and Tell session. For detailed guidelines about the submission, please see the "Show & Tell Guidelines" under "For Authors".

1 0

Job Opening (Univ. Vienna, postdoc-level): Scientific Coordinator at the Research Network Data Science
by Benjamin Roth 12 Feb '25

12 Feb '25

The research network Data Science at the University of Vienna is looking for a highly motivated Scientific Coordinator. We are offering an excellent working environment in an interdisciplinary team. This full-time position is limited to 39 months. Application deadline: 7 March 2025. Main Responsibilities and Duties: * Strengthening collaboration between the research network and external partners, including NGOs, governments, and companies * Developing strategies to bridge society and data science research at Uni Vienna * Participation in data science research * International publishing and presentation activities * Supervision of students; Teaching as regulated in the wage agreement Further information: https://jobs.univie.ac.at/job/Scientific-Coordinator-Data-Science-Post-Doc/… -- Univ.-Prof. Dr. Benjamin Roth Digitale Textwissenschaften Universität Wien Kolingasse 14 Raum 5.17 1090 Wien email: benjamin.roth(a)univie.ac.at tel: +43 14277 79513 virtual coffee (Tuesday 2pm CEST): https://www.benjaminroth.net/virtual_coffee video call: https://univienna.zoom.us/j/93796507934?pwd=VFg5dW9JbStPUml6WFVtOWJXV3phQT09 web: https://dm.cs.univie.ac.at/team/person/112089/

1 0

Job opening: Research position on Watermarking for Large Language Models at the Bauhaus-Universität Weimar
by Tim Gollub 12 Feb '25

12 Feb '25

The Webis Group at the Bauhaus-Universität Weimar (weimar.webis.de) is offering a three-year research position in a joint BMBF project with the Fraunhofer IDMT and Artifact GmbH. Salary is based on the collective agreement for the public sector in Germany, TV-L 13, 100%. The engagement can start immediately, but we are also flexible if the start date of a suitable candidate is later this year. There is the possibility of further employment in our research group. The offered position deals with innovations and current developments in the field of Text Watermarking and Large Language Models and is very attractive for PhD students or experienced postdocs interested in innovative and fundamental research in the field of Artificial Intelligence, Machine Learning, and Natural Language Processing. The offered position is considered as qualification position, i.e., for non-postdocs we actively support to do a PhD (Dr. rer. nat.). Prospective candidates should have finished either a master or a PhD in computer science, mathematics, statistics or a related field with excellent or very good grades. Solid knowledge of mathematics and statistics is required for this position - as well as very good programming skills. We are an experienced research group where team spirit and active collaboration are top priorities. We are looking for open-minded graduates, PhD students, or postdocs who want to develop both as researchers and as a person. The working language of our group is English; fluency in German is not required. We are interested in increasing the proportion of women in computer science research and particularly welcome applications from suitably qualified women. We do not discriminate on the basis of religion, color, gender, age, or disability and are committed to a family-friendly recruitment policy. Interested and qualified candidates are invited to submit their application by March 2nd to tim.gollub(a)uni-weimar.de. The application (preferably as a single PDF file) should contain the following documents: a cover letter describing yourself and your interests, a detailed CV, high school diploma (Abitur), academic transcripts stating courses taken and grades earned, and a list of publications (if any). Benno Stein Online version: https://webis.de/for-students.html#vacancies -- Prof. Dr. Benno Stein Bauhaus-Universität Weimar Intelligent Information Systems Group webis.de | weimar.webis.de

1 0

First call for papers: The fourth Generation, Evaluation & Metrics Workshop
by Simon Mille 12 Feb '25

12 Feb '25

Dear colleagues, The fourth iteration of the Generation, Evaluation & Metrics (GEM) Workshop <https://gem-benchmark.com/workshop> will be held as part of ACL <https://2025.aclweb.org/>, July 27–August 1st, 2025. This year we’re planning a major upgrade to the workshop, which we dub GEM2, through the introduction of a large dataset of 1B model predictions together with prompts and gold standard references, encouraging researchers from all backgrounds to submit work on meaningful, efficient and robust evaluation of LLMs. Overview Evaluating large language models (LLMs) is challenging. Running LLMs over medium or large scale corpus can be prohibitively expensive; they are consistently shown to be highly sensitive to prompt phrasing, and it is hard to formulate metrics which differentiate and rank different LLMs in a meaningful way. Consequently, the validity of the results obtained over popular benchmarks such as HELM or MMLU, lead to brittle conclusions. We believe that meaningful, efficient, and robust evaluation is one of the cornerstones of the scientific method, and that achieving it should be a community-wide goal. In this workshop we seek innovative research relating to the evaluation of LLMs and language generation systems in general. We welcome submissions related, but not limited to, the following topics: - Automatic evaluation of generation systems. - Creating evaluation corpora and challenge sets. - Critiques of benchmarking efforts and responsibly measuring progress in LLMs. - Effective and/or efficient NLG methods that can be applied to a wide range of languages and/or scenarios. - Application and evaluation of LLMs interacting with external data and tools. - Evaluation of sociotechnical systems employing large language models. - Standardizing human evaluation and making it more robust. - In-depth analyses of outputs of existing systems, for example through error analyses, by applying new metrics, or by testing the system on new test sets. Following the success of last iterations, GEM2 will also hold an Industrial Track, which aims to provide actionable insights to industry professionals and to foster collaborations between academia and industry. This track will address the unique challenges faced by non-academic colleagues, highlighting the differences in evaluation practices between academic and industrial research, and explore the challenges in evaluating generative models with real-world data. The Industrial Track invites submissions covering the following topics, including (but not limited to): - Breaking Barriers: Bridging the Gap between Academic and Industrial Research. - From Data Diversity to Model Robustness: Challenges in Evaluating Generative Models with Real-World Data. - Beyond Metrics: Evaluating Generative Models for Real-World Business Impact. How to submit? Submissions can take either of the following forms: - Archival Papers describing original and unpublished work can be submitted in a between 4 and 8 page format. - Non-Archival Abstracts To discuss work already presented or under review at a peer-reviewed venue, we allow the submission of 2-page abstracts. Papers should be submitted directly through OpenReview <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/GEM&referrer=%…>, selecting the appropriate track, and conform to ACL 2025 style guidelines <https://2025.aclweb.org/calls/main_conference_papers/#paper-submission-deta…>. We additionally welcome presentations by authors of papers in the Findings of the ACL. The selection process is managed centrally by the workshop chairs for the conference and we thus cannot respond to individual inquiries about Findings papers. However, we will try our best to accommodate authors’ requests. Important Dates - April 11: Direct paper submission deadline (ARR). - May 5: Pre-reviewed (ARR) commitment deadline. - May 19: Notification of acceptance. - June 6: Camera-ready paper deadline. - July 7: Pre-recorded videos due. - July 31 - August 1: Workshop at ACL in Vienna. ContactFor any questions, please check the workshop page <https://gem-benchmark.com/workshop> or email the organisers: gem-benchmark-chairs(a)googlegroups.com. best, simon *ADAPT Research Centre / Ionaid Taighde ADAPT* *School of Computing, Dublin City University, Glasnevin Campus / Scoil na Ríomhaireachta, Campas Ghlas Naíon, Ollscoil Chathair Bhaile Átha Cliath*

1 0

2026

2025

2024

2023

2022

Corpora