February 2025 - Corpora

Call for participation in "Machine Translation Metrics for Indigenous languages" task, AmericasNLP 2025
by ali.marashian＠colorado.edu 25 Feb '25

25 Feb '25

The AmericasNLP 2025 Shared Task on machine translation metrics for Indigenous languages is a competition intended to motivate the advancement of automatic evaluation metrics for machine translation, with a focus on translation into Indigenous languages. Participants will build metrics to evaluate the quality of translations from Spanish into Guarani, Bribri, and Nahuatl. Many Indigenous languages of the Americas have linguistic characteristics that are uncommon in the languages typically studied in natural language processing (NLP). For example, Indigenous languages can often be polysynthetic, and they frequently lack orthographic standardization, both of which pose challenges for, e.g., the widely used BLEU and ChrF scores. The goal of the AmericasNLP 2025 shared task on machine translation metrics for Indigenous languages is to encourage researchers to tackle the challenge of creating automatic evaluation metrics for MT systems with a focus on Indigenous languages. Shared task description: https://turing.iimas.unam.mx/americasnlp/2025_st_3.html Registration: https://docs.google.com/forms/d/e/1FAIpQLSfmV9gyab03pGGzzDJ9DohOf9AkDaZf_94… AmericasNLP will be held Albuquerque, New Mexico (NAACL 2025). The workshop date is May 4, 2025. Thanks, Ali, on behalf of the AmericasNLP team

1 0

The 24th IFIP Conference e-Business, e-Services, and e-Society (I3E 2025): Fourth Call for Papers
by Announce 25 Feb '25

25 Feb '25

*** Fourth Call for Papers *** The 24th IFIP Conference e-Business, e-Services, and e-Society (I3E 2025) September 9-11, 2025, 5* St. Raphael Resort and Marina, Limassol, Cyprus https://cyprusconferences.org/i3e2025/ (*** Proceedings to be published by Springer in LNCS ***) (*** Journal Special Issue with Springer's SN Computer Science ***) Conference theme: “Pervasive digital services for people’s well-being, inclusion and sustainable development” OVERVIEW Next-gen digital services contribute to people’s well-being, inclusion, and sustainable development, re-shaping e-business, e-services, and e-society. Such services are pervasive both since they run on a large variety of heterogeneous devices and they permeate various aspects of daily life, by offering accessible and personalised experiences to all individuals. The proposed theme advocates for the design, implementation and operations of novel digital solutions that satisfy the needs of different individuals, while contributing to their well-being and to preserving the Planet. I3E 2025 will collect contributions about the creation and management of user-centric accessible platforms, applications, and services that empower individuals to live healthier and more fulfilling lives. The proposed theme aims at emphasizing how it is possible to leverage different technologies to address pressing societal challenges such as, for instance, healthcare access, education, poverty alleviation, sustainable usage of resources, and social equity, towards a more inclusive and sustainable future. TOPICS OF INTEREST Areas of particular interest include but are not limited to: e-Business • Innovative e-business models • Inter-organizational systems • Business process integration • Business process re-engineering • e-Marketplaces, e-Hubs and portals • Digital goods and products • User behaviour modeling • Mobile business • Enterprise application integration • e-Negotiations, auctioning and contracting • Supply, demand, and value chains • e-Commerce content management • Dynamic pricing models • Trust and security • Mobile Commerce • Business Intelligence • Business Ontologies and Models • E-Business Models e-Services • e-Service composition • Inter-organizational services • e-Collaboration and e-Services • Service-oriented computing • Web services • Semantic web services • Service workflows • Virtual organizations and coalitions • Virtual enterprises and virtual markets • Web 2.0 applications • Agent-oriented e-Services • P2P co-operation models • Ubiquitous, mobile, and pervasive services • Application service management • Services and service management in the cloud-edge continuum • Next-gen AI services • Enterprise Ontologies • Accessibility • Usability e-Society • e-Government (e.g. G2G, G2B, or G2C) • Digital cities and regions • e-Democracy and e-Governance • e-Inclusion to information society • e-Health and e-Education • Public e-Services for citizens and enterprises • One-stop government service integration • Mobile public services • Multimedia and multilingualism • Digital culture and digital divide • Privacy and security • Legal societal and cultural issues • Public-private partnerships • International dimension of e-Gov • E-society and AI • Digital Transformation • Social Computing • Green Computing • Sustainable Technologies • Humanitarian & Emergency Management • Digital Inclusion • Digital Literacy SUBMISSION Authors should submit original, unpublished research papers. All papers must not simultaneously be submitted to another journal or conference. All accepted papers will be published in the conference proceedings. Therefore, submissions should not be under consideration for any other conference or journal outlet. Authors should consult Springer’s authors’ guidelines and use their proceedings templates to prepare their papers (https://www.springer.com/gp/computer-science/lncs/conference-proceedings-gu…). Authors can submit their proceedings articles using the EasyChair platform. Please use the following link: https://easychair.org/conferences/?conf=i3e2025 . Length of papers The most common types of papers accepted for publication are full papers (12 pages) and short papers (7 pages). We only wish to publish papers of significant scientific content. Journal Special Issue Authors of selected papers will be invited to submit an extended and revised version of their paper (with at least 30% additional material) for fast-track review and publication in Springer's SN Computer Science (https://link.springer.com/journal/42979). IMPORTANT DATES • Paper Submission: May 19, 2025 (AoE) • Author Notification: June 23, 2025 • Camera-ready: June 30, 2025 • Author Registration: June 30, 2025 ORGANISATION Conference Chair • George A. Papadopoulos, University of Cyprus Conference Co-Chairs • Yogesh K. Dwivedi, Emerging Markets Research Centre (EMaRC) • Georgia Kapitsaki, University of Cyprus • Matti Mäntymäki, University of Turku • Ilias Pappas, Norwegian University of Science and Technology • Marinos Themistocleous, University of Nicosia Program Co-Chairs • Achilleas Achilleos, Frederick University of Cyprus • Stefano Forti, University of Pisa • Angelika Kokkinaki, University of Nicosia

1 0

Call for Participation – IWSLT 2025 Model Compression Track
by Matteo Negri 25 Feb '25

25 Feb '25

Apologies for cross-posting We are pleased to announce the Model Compression track <https://iwslt.org/2025/model-compression> at IWSLT 2025 <https://iwslt.org/2025/> (22nd International Conference on Spoken Language Translation, in conjunction with ACL 2025 <https://2025.aclweb.org/>). Motivation Text and speech foundation models have revolutionized many natural language processing tasks, including speech-to-text translation. However, their large size and high computational demands present significant challenges for real-world deployment, particularly in resource-constrained environments such as mobile devices, embedded systems, and edge computing. Reducing the size of large, general-purpose models while preserving—or even enhancing—their performance in specific tasks or language settings is essential for making them more efficient, accessible, and sustainable. The Task in a Nutshell The Model Compression track evaluates participants’ ability to apply model compression techniques to a large multilingual speech-to-text model, the need for accessibility and deployment feasibility with the requirement for good performance in speech-to-text translation. Participants are invited to apply pruning, quantization, distillation, or other compression techniques to optimize Qwen2-Audio <https://huggingface.co/Qwen/Qwen2-Audio-7B> (8.2B parameters, 16GB storage) for English-German and English-Chinese speech translation. Submissions and Evaluation Submissions under either of the two allowed data conditions (constrained or unconstrained, depending on the datasets used to support the model compression process) will be categorized into five compression bins, ranging from less than 200MB to 4GB of storage demand, and evaluated based on model size and COMET <https://huggingface.co/Unbabel/wmt22-comet-da> translation scores. Multiple submissions are allowed, with human evaluation conducted for the top-performing models. Guidelines, details, and contact information For submission guidelines and further details, please visit the IWSLT 2025 Model Compression track web page <https://iwslt.org/2025/model-compression> or contact us at iwslt_offline_task_submission(a)fbk.eu. Conference Information IWSLT 2025 will be co-located with ACL 2025 <https://2025.aclweb.org/>, taking place from 31 July to 1 August 2025 in Vienna, Austria. Important Dates - Test set release: April 1, 2025 - Submission of system outputs: April 15, 2025 - System description paper submission deadline: April 21, 2025 - Camera-ready deadline: June 1, 2025 - IWSLT conference in Vienna: July 31 – August 1, 2025 Best regards, Matteo Negri (Fondazione Bruno Kessler) On behalf of the IWSLT 2025 Model Compression track organizers: Marco Gaido (FBK), Marco Turchi (Zoom), Sebastian Stüker (Zoom), Jan Niehues (KIT) -- -- Le informazioni contenute nella presente comunicazione sono di natura privata e come tali sono da considerarsi riservate ed indirizzate esclusivamente ai destinatari indicati e per le finalità strettamente legate al relativo contenuto. Se avete ricevuto questo messaggio per errore, vi preghiamo di eliminarlo e di inviare una comunicazione all’indirizzo e-mail del mittente. -- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

1 0

Corpus webinar 27 February 11am-12pm UK time
by Brezina, Vaclav 25 Feb '25

25 Feb '25

Dear all, On Thursday 27th Feb 11am-12pm UK time, we are running another one of our webinars, introducing Lancaster University's online programmes (MA, PG Certificate, short courses for credit) in Corpus Linguistics. This time, we will be also demonstrating the use of specialised software tools for the analysis of corpora (#LancsBox X and Lancaster Stats Tools online). Join us on Thursday by filling in this form (a link to a Teams meeting will be sent to you automatically) https://forms.office.com/e/uppRBrE5AF Best, Vaclav Professor Vaclav Brezina Professor in Corpus Linguistics Department of Linguistics and English Language ESRC Centre for Corpus Approaches to Social Science Faculty of Arts and Social Sciences, Lancaster University Lancaster, LA1 4YD Office: County South, room C05 T: +44 (0)1524 510828 [cid:image001.jpg@01DB8766.513C93A0]@vaclavbrezina [cid:image002.jpg@01DB8766.513C93A0]<http://www.lancaster.ac.uk/arts-and-social-sciences/about-us/people/vaclav-…>

1 0

CfP: Journal of Digital Islamicate Research
by Mai Zaki 25 Feb '25

25 Feb '25

Dear all, Pls read the CfP below and share with your academic networks. *Call for Papers – Journal of Digital Islamicate Research (JDIR)* *Issue: July 2025 | Submission Deadline: April 1, 2025* The *Journal of Digital Islamicate Research* (JDIR) invites scholars, researchers, and practitioners to submit original contributions for its upcoming issue, scheduled for publication in July 2025. As a peer-reviewed journal, JDIR is dedicated to advancing the intersection of Digital Humanities (DH) and Islamicate Studies, fostering innovative computational, analytical, and theoretical approaches to the study of Middle Eastern and Islamicate cultures—both past and present. We particularly welcome interdisciplinary and methodologically diverse studies that integrate Cultural Analytics, Natural Language Processing (NLP), Artificial Intelligence (AI), Geographic Information Systems (GIS), visualization techniques, and other digital methodologies to examine the rich textual, visual, and material culture of the Islamicate world. We are especially interested in expanding our focus to include literary, artistic, and cultural production within the Islamicate world, encouraging contributions that explore how digital tools transform the study of Islamicate literature, aesthetic practices, media, and performance cultures across different historical periods and geographic regions. Topics of interest include, but are not limited to: - Computational and Quantitative Analyses of Islamicate Texts (Arabic, Persian, Ottoman Turkish, Urdu, and other Middle Eastern languages) - Digital Methods in the Study of Islamicate Literature and Poetics - Visualization and Big Data Approaches to Islamicate Cultural Heritage - Applications of AI, NLP, and Machine Learning in Middle Eastern Digital Humanities - Corpus Linguistics and Stylometric Studies of Islamicate Writing Traditions - Islamicate Digital Archives, Repositories, and Text Encoding Initiatives - Non-Muslim Literary and Cultural Traditions in Islamicate Contexts (e.g., Geniza research, Judeo-Arabic, Syriac, Armenian, Persianate Jewish texts) - Digital Approaches to Islamic Manuscripts, Calligraphy, and Epigraphy - Mapping and GIS Analysis of Islamicate History and Cultural Networks - Computational Studies of Islamic Art, Architecture, and Visual Culture - Digital Media and Islamicate Popular Culture: Film, Music, and Performance in Digital Contexts - Islamicate Digital-Born and Digitally-Reformatted Materials in the Contemporary World - Ethical Considerations in Digital Humanities and Islamicate Knowledge Production The *Journal of Digital Islamicate Research* accepts manuscripts in *English and Arabic*. Submissions should be made via the *Editorial Manager* on the journal website <https://brill.com/view/journals/jdir/jdir-overview.xml?contents=editorialco…> . For inquiries or further information, please contact: jdir(a)brill.com We look forward to your contributions in shaping this exciting issue! Mai Zaki Co-editor in Chief Journal of Digital Islamicate Research

1 0

CFP: NSLP 2025 – 2nd Int. Workshop on Natural Scientific Language Processing and Research Knowledge Graphs
by Georg Rehm 25 Feb '25

25 Feb '25

2nd International Workshop on Natural Scientific Language Processing and Research Knowledge Graphs (NSLP 2025) 01 or 02 June 2025 (tbc) Portoroz, Slovenia (NSLP 2025 is co-located with ESWC 2025) https://nfdi4ds.github.io/nslp2025/ Scientific research is almost exclusively published in unstructured text formats, which are not readily machine-readable. While technological approaches can help to get this flood of scientific information and new knowledge under control, the development of such technologies is very complex in practice and hinders the creation of infrastructures and systems to track research and assist the scientific community with applications such as dedicated scientific search engines and recommender systems. The 2nd International Workshop on Natural Scientific Language Processing and Research Knowledge Graphs (NSLP) aims to bring together researchers working on the processing, analysis, transformation and exploitation of scientific language and research knowledge graphs including all relevant sub-topics. NSLP 2025 is a full-day workshop co-located with ESWC 2025 <https://2025.eswc-conferences.org/> to be held in Portoroz, Slovenia on 01 or 02 June 2025 (to be confirmed). Topics of interest include, but are not limited to Research/Scientific Knowledge Graphs (RKGs/SKGs) and other forms of structured scientific knowledge representation Information Extraction for RKGs/SKGs Question Answering over RKGs/SKGs Other types of usage of RKGs/SKGs for downstream applications Scientific LLMs: LLMs for Natural Scientific Language Processing (NSLP) NSLP (monolingual, cross-lingual, multilingual) Language Resources and Language Technologies for NSLP Domain-specific Adaptation of NSLP Methods Information Extraction from Scholarly Publications Classification of Scholarly Publications (document collections, individual documents, parts of documents) Summarisation of Scholarly Publications Scholarly Information Retrieval and Scientific Search Engines Digital Libraries of Scholarly Information Bibliometrics and Scientometrics Micropublications and Nanopublications Important Dates Paper submission deadline: 06 March 2025 Notification of acceptance: 03 April 2025 Camera-ready submission: 17 April 2025 Workshop: 01 or 02 June 2025 (tbc) Submissions The NSLP 2025 workshop invites submissions of regular long papers, position papers, and short papers presenting negative results, in-progress projects, and demos. We especially encourage submissions from junior researchers and students from diverse backgrounds. The workshop invites anonymous submissions of regular long papers (up to 15 pages without references and appendix) and short papers (up to 8 pages without references and appendix) presenting negative results, in-progress projects, and demos. In both categories, position papers can be submitted as well. Authors are permitted to include an optional appendix of up to 2 pages. However, reviewers will not be mandated to review the appendix; all papers must be self-contained. Reviewing will be performed double-blind. Reviewers will not actively try to identify the authors. Submissions must be in PDF, formatted in the style of the Springer Publications format for Lecture Notes in Computer Science (LNCS). The proceedings of this workshop will be published as an Open Access volume in the Springer series Lecture Notes in Artificial Intelligence (LNAI), fully sponsored by the NFDI4DS project. At least one author per contribution must register for the conference for presentation as ESWC 2025 (including all workshops) is an in-person event. We will not accept work that is under review or has already been published in or accepted for publication in a journal, another conference, or another workshop. All submissions are done via EasyChair: https://easychair.org/conferences?conf=nslp2025 Keynote Speaker Michele Pasin, Digital Science, UK Shared Tasks NSLP 2025 offers three shared tasks: Shared Task 1: MESD: Metadata Extraction from Scholarly Documents The MESD shared task aims to improve metadata extraction from scholarly publications to enhance their FAIRness (Findability, Accessibility, Interoperability, Reusability). Given training data of 500 labelled scientific documents along with their extracted text, participants are asked to develop models that output metadata of nine predefined labels. A label-free test set of 100 samples will be released for final evaluation, where systems will be ranked based on F1 score using Levenshtein Similarity (≥90%). Shared Task 2: ReadMe2KG: Github ReadMe to Knowledge Graph The ReadMe2KG shared task focuses on fine-grained Named Entity Recognition (NER) in GitHub README files to enhance the NFDI4DS knowledge graph. Participants will develop classifiers to identify 10 entity types, including “Dataset,” “Software,” and “Publication,” from a dataset of approximately 160 README files. The task aims to improve the integration of research-related metadata from GitHub repositories into the research data lifecycle. Shared Task 3: FoRC: Field of Research Classification The FoRC shared task aims to classify scientific documents into (sub-)topics according to a predefined schema. The second iteration of the task (see NSLP 2024 for the first) will focus on classifying computational linguistics publications taken from the ACL Anthology using the FoRC4CL data and taxonomy. Weakly supervised data will be added to FoRC4CL to create a bigger training corpus for classifying publications into 170 (sub-)topics of the field of computational linguistics. The NSLP 2025 website <https://nfdi4ds.github.io/nslp2025/> provides more information on the shared tasks. Organisers of NSLP 2025 Georg Rehm, DFKI & HU Berlin, Germany Sonja Schimmler, TU Berlin & Fraunhofer FOKUS, Germany Stefan Dietze, GESIS & HHU Düsseldorf, Germany Natalia Manola, OpenAIRE, Greece Contact Georg Rehm <georg.rehm(a)dfki.de <mailto:georg.rehm@dfki.de>>

1 0

ClinIQLink 2025 – Public Sample Dataset Now Available
by Brandon 25 Feb '25

25 Feb '25

Dear Colleagues, We are pleased to announce that the ClinIQLink 2025 public sample dataset has been released and is now available at: https://github.com/Brandonio-c/ClinIQLink_Sample-dataset This sample dataset provides a representative subset of our full dataset, allowing participants to: * Familiarize themselves with the question format * Test their models before the full evaluation * Benchmark performance and refine their approaches About ClinIQLink 2025 ClinIQLink 2025 is an evaluation task as part of the BioNLP Workshop at ACL 2025, assessing the ability of generative AI models to produce factually accurate medical information, particularly in knowledge retrieval for hallucination detection. See more on our challenge page<https://brandonio-c.github.io/ClinIQLink-2025/> Upcoming Key Dates * March 01, 2025 – Release of the Testing Dataset & Evaluation Framework on CodaBench * April 15, 2025 – System submission deadline * May 15, 2025 – Paper submission deadline * July 31, 2025 – BioNLP Workshop at ACL 2025 Useful Links * Official Challenge Page: https://brandonio-c.github.io/ClinIQLink-2025/ * ClinIQLink on CodaBench: https://www.codabench.org/competitions/5117/ * Sample Dataset: https://github.com/Brandonio-c/ClinIQLink_Sample-dataset If you have any questions, please do not hesitate to contact Brandon Colelough at brandon.colelough(a)nih.gov<mailto:brandon.colelough@nih.gov>. We look forward to your participation in this exciting initiative. Kind regards, Brandon Colelough (He / Him) [News, Events, and Updates]NIH Fellow | Fulbright Scholar | ADF Signals Officer | Electrical Engineer National Institutes of Health – National Library of Medicine (LHC) M: +61 481 269 667<tel:+61481269667> (AUS) | M: +1 (202) 367-7230<tel:+12023677230> (US) E: brandcol(a)umd.edu<mailto:brandcol@umd.edu> | E: brandon.colelough(a)gmail.com<mailto:brandon.colelough@gmail.com> L: www.linkedin.com/in/brandon-colelough<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.linked…>

1 0

CFP: The First Workshop on Integrating NLP and Psychology to Study Social Interactions (NLPSI)
by Neele Falk 24 Feb '25

24 Feb '25

*** CALL FOR PAPERS: The First Workshop on Integrating NLP and Psychology to Study Social Interactions (NLPSI) *** NLPSI will be co-located with the International AAAI Conference on Web and Social Media (ICWSM’25) and will take place in person on Monday 23 June 2025. ** Background and Scope ** Recent advances in natural language processing (NLP) have enabled not only the modeling of syntax and semantics but also the analysis of higher-level aspects of human communication—such as pragmatics, social dynamics, and emotional expression. Building on these advances, we can now address foundational questions that remain relatively unexplored in NLP: What are the core psychological processes that shape human behavior and communication? What factors influence how individuals perceive, process, and produce language, and how do these processes impact communication? Psychology can offer valuable insights into these questions, as it has been studying human behavior, perception and communication for years. At the same time, NLP enables us to go beyond controlled, small-scale experiments and conduct large-scale studies to better explore certain theories and research questions in psychology. NLPSI workshop seeks to bridge the two disciplines with a primary focus on NLP research that is grounded in psychological theories. This is an interdisciplinary workshop, and we invite researchers from NLP, Social Psychology, Communication Sciences, Affective Computing, and related fields to submit their work. We welcome submissions on topics including, but not restricted to, the following: - Psychological constructs (e.g., beliefs, motives, feelings, affect, personality). - Psychological studies, especially those focused on interaction. - Language and social identities, including ethnicity and group affiliation. - Communication patterns such as empathy, persuasion, and conflict resolution - Role of emotions in interpersonal communication, including phenomena like emotion contagion and interpersonal emotion regulation. - LLMs in experimental, interactional studies. - Cross-cultural variations in communication and behavior. ** Submission Types ** - Long papers (5 to 8 pages) that present original research, from preliminary findings to established contributions, including theory, experiments, or applications. - Short papers (up to 4 pages) that introduce emerging ideas, work in progress, or early-stage research with clear significance. - Extended Abstracts (up to 2 pages)that present ongoing work, position papers, previously published work, or research projects. Abstracts can be submitted either for inclusion in the proceedings (archival) or as non-archival contributions. ** Format ** All papers must follow the AAAI two-column, camera-ready style, for US Letter (8.5" x 11") paper, using Type 1 or TrueType fonts (available templates: AAAI 2025 Author Kit on Overleaf or AAAI 2025 Author Kit.zip [Word | LaTeX]). The review process will be double-blind. Please anonymize your papers by removing identifying information such as author names, affiliations, and funding details. ** Important Dates ** Paper submission deadline: March 21, 2025 Notification of acceptance: April 30, 2025 Camera ready: May 26, 2025 NLPSI Workshop day: June 23rd, 2025 Note: All deadlines are 11:59 pm UTC -12h (anywhere on earth). ** Organizers ** Aswathy Velutharambath, University of Bamberg Sofie Labat, Ghent University Neele Falk, University of Stuttgart Flor Miriam Plaza-del-Arco, Bocconi University Roman Klinger, University of Bamberg Véronique Hoste, Ghent University ** Website and Contact ** For further information and updates, visit the NLPSI website: nlpsi-workshop.github.io If you have any questions, please contact nlpsi-workshop-organizers.nlproc(a)uni-bamberg.de

1 0

First CfP for papers R2CASS2025@ICWSM 2025: International workshop on "Social Science Meets Web Data: Reproducible and Reusable Computational Approaches"
by taimoor.nlp＠gmail.com 23 Feb '25

23 Feb '25

R2CASS 2025: International workshop on "Social Science Meets Web Data: Reproducible and Reusable Computational Approaches" Co-located with ICWSM 2025: International AAAI Conference on Web and Social Media Copenhagen, Denmark | June 23, 2025 Workshop website: https://r2cass2025.wordpress.com/ Submission link: https://easychair.org/cfp/R2CASS2025 ------------------------------- Call for papers: R2CASS2025 – International workshop “Social Science Meets Web Data: Reproducible and Reusable Computational Approaches” at ICWSM 2025 Paper submission deadline: March 31st, 2025 Website: https://r2cass2025.wordpress.com/ Submission: https://easychair.org/my/conference?conf=r2ca The first international workshop “Social Science Meets web Data: Reproducible and Reusable Computational Approaches” (R2CASS2025) will be held in conjunction with “International AAAI Conference on Web and Social Media” (ICWSM 2025) in Copenhagen, Denmark on June 23rd, 2025. The workshop will be held in-person and at least one author of the accepted papers will be required to register and present it in the workshop. The papers presented will be published in the workshop proceedings of the conference. Artificial Intelligence (AI) based models have a growing influence in social science research for analyzing behavioral patterns on social media and other digital platforms. Computational reproducibility has been a concern with these models as they deal with living data that is likely to change, contain personal information and therefore, ethical restrictions on their use. The workshop aims to bring together researchers and practitioners to discuss and exchange ideas towards potential interdisciplinary collaborations from computer science, social science, meta-science and other related disciplines. It provides a platform to present and critically analyze computational reproducibility guidelines and checklists for social sciences. The participants will focus on the open challenges and propose methodologies in computational reproducibility for social science towards improving research transparency, reproducibility, and reusability. Workshop participants are also encouraged to volunteer for and participate in the interactive replicability session attempting to replicate existing methods on sample data. (for participation in the interactive replicability session, please contact the workshop organizers at https://r2cass2025.wordpress.com/contact-2/) The workshop calls for theoretical and practical research contributions that employ qualitative, quantitative and analytical approaches including full papers, short papers, resource papers, position papers and posters on the topics (but not limited to): Data and software management in machine learning and natural language processing-driven studies Computational methods on sentiment analysis, bias analysis, toxicity, and sexism detection Text categorization and topic analysis Digital behavior analysis on social media and other digital platforms Computational reproducibility checklists and workflows in social science FAIR principles in ML research for social science Open Science applications and reproducibility challenges Metadata standards for ML/NLP research Tools for replicating complex social science models using web-based data Integration of open-source ML/NLP tools for web data analysis Submission guidelines As per AAAI-ICWSM guidelines, all papers must be submitted as high-resolution PDF files formatted in AAAI two-column, camera-ready style, for US Letter (8.5” x 11”) paper. Full papers are recommended to be 8 pages long and must be at most 11 pages long, including only the main text and the references. The mandatory Ethics Checklist (and brief additional Ethics Statement, if desired, see below), optional appendices, etc. do not count toward the page limit and should be placed after the references. Appendices, if they exist, should be placed after the Ethics Checklist. Revision papers and final camera-ready full papers can be up to 12 pages. Dataset papers must be no longer than 10 pages, Poster papers must be no longer than 4 pages, and Demo descriptions must be no longer than 2 pages. No source files (Word or LaTeX) are required at the time of submission for review; only the PDF file is permitted. Finally, the copyright slug may be omitted in the initial submission phase, and no copyright form is required until a paper is accepted for publication. For more on paper formatting guidelines, please visit ICWSM guidelines. Co-organizers Fakhri Momeni, GESIS – Leibniz Institute for the Social Sciences, Germany M. Taimoor Khan, GESIS – Leibniz Institute for the Social Sciences, Germany Arnim Bleier, GESIS – Leibniz Institute for the Social Sciences, Germany Tony Ross-Hellauer, Know-Center, Austria

1 0

2nd CFP: 5th Workshop on Scholarly Document Processing (SDP 2025) @ACL 2025
by Georg Rehm 22 Feb '25

22 Feb '25

Dear colleagues, You are invited to participate in the 5th Workshop on Scholarly Document Processing (SDP 2025) to be held at ACL 2025 in Vienna, Austria. SDP 2025 will consist of a research track and five shared tasks. The call for research papers is described below, and more details can be found on our website, https://sdproc.org/2025/ <https://sdproc.org/2025/>. Papers must follow the ACL format and conform to the ACL 2025 Submission Guidelines. Paper submission has to be done through OpenReview: https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc> Website: https://sdproc.org/2025/ <https://sdproc.org/2025/> Submission site: <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc>> X (Twitter): https://twitter.com/sdpworkshop <https://twitter.com/sdpworkshop> Shared tasks: https://sdproc.org/2025/sharedtasks.html <https://sdproc.org/2025/sharedtasks.html> Paper submission deadline: March 1 (Saturday), 2025 Call for Research Papers Scholarly literature is the chief means by which scientists and academics document and communicate their results and is therefore critical to the advancement of knowledge and improvement of human well-being. At the same time, this literature poses challenges to NLP uncommon in other genres, such as specialized language and high background knowledge requirements, long documents and strong structural conventions, multimodal presentation, citation relationships among documents, an emphasis on rational argumentation, and the frequent availability of detailed metadata and experimental data. These challenges necessitate the development of NLP methods and resources optimized for this domain. The Scholarly Document Processing (SDP) workshop provides a venue for discussing these challenges, bringing together stakeholders from different communities including computational linguistics, machine learning, text mining, information retrieval, digital libraries, scientometrics and others, to develop methods, tasks, and resources in support of these goals. This workshop builds on the success of prior workshops: SDP workshops held at EMNLP 2020, NAACL 2021, COLING 2022, and ACL 2024, and the 1st and 2nd SciNLP workshops held at AKBC 2020 and 2021. In addition to having broad appeal within the NLP community, we hope the SDP workshop will attract researchers from other relevant fields including meta-science, scientometrics, data mining, information retrieval, and digital libraries, bringing together these disparate communities within ACL. Topics of Interest We invite submissions from all communities demonstrating usage of and challenges associated with natural language processing, information retrieval, and data mining of scholarly and scientific documents. Relevant topics include (but are not limited to): Large Language Models (LLMs) for science Representation learning and language modeling Information extraction and NER Document understanding Summarization and generation Question-answering Discourse modeling/argumentation mining Network analysis Bibliometrics, scientometrics, and altmetrics Reproducibility and research integrity, including new challenges posed by generative AI Peer review tools, principles and technology Metadata and indexing Inclusion of datasets and computational resources Research infrastructures and digital libraries Increasing the representation in scholarly work of disadvantaged populations LLM-based interfaces to consume/produce scholarly documents Impact of scholarly communication on popular discourse Submission Information Authors are invited to submit full and short papers with unpublished, original work. Submissions will be subject to a double-blind peer-review process. Accepted papers will be presented by the authors at the workshop either as a talk or a poster. All accepted papers will be published in the workshop proceedings (proceedings from previous years can be found here: https://aclanthology.org/venues/sdp/ <https://aclanthology.org/venues/sdp/>), which will be published in the ACL Anthology. The submissions must be in PDF format and anonymized for review. All submissions must be written in English and follow the ACL 2025 formatting requirements: Long paper submissions: up to 8 pages of content, plus unlimited references. Short paper submissions: up to 4 pages of content, plus unlimited references. Submission Website: Paper submission has to be done through openreview: <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc <https://openreview.net/group?id=aclweb.org/ACL/2025/Workshop/SDProc>> Final versions of accepted papers will be allowed 1 additional page of content so that reviewer comments can be taken into account. Important Dates (Main Research Track) First call for workshop papers: December 19, 2024 Second call for workshop papers: February 21, 2025 Paper submission deadline: March 1, 2025 Pre-reviewed (ARR) submission deadline: March 25, 2025 Notification of acceptance: April 17, 2025 Camera-ready paper due: May 16, 2025 Workshop dates: July 31 – August 1, 2025 Note: Shared task submission deadlines and other important dates to be announced. SDP 2024 Keynote Speakers We are excited to have several keynote speakers at SDP 2025. Tom Hope <https://tomhoper.github.io/>, Assistant Professor at Hebrew University of Jerusalem and Research Scientist at Allen Institute for AI. James A. Evans <https://sociology.uchicago.edu/directory/James-A-Evans>, Professor and Director of the Knowledge Lab at University of Chicago and External Professor at the Santa Fe Institute. TBA SDP 2025 Shared Tasks SDP 2025 will host six exciting shared tasks. More information about all shared tasks is provided on the workshop website:https://sdproc.org/2025/sharedtasks.html <https://sdproc.org/2025/sharedtasks.html> Detecting automatically generated scientific papers (DAGPap 25) A big problem with the ubiquity of Generative AI is that it has now become very easy to generate fake scientific papers. This can erode public trust in science and attack the foundations of science: are we standing on the shoulders of robots? The Detecting Automatically Generated Papers (DAGPAP) competition aims to encourage the development of robust, reliable AI-generated scientific text detection systems, utilizing a diverse dataset and varied machine learning models in a number of scientific domains. Organizers: Savvas Chamezopoulos, Dan Li, Anita de Waard (Elsevier). Contextualizing Scientific Figures and Tables (Context 25) Interpreting scientific claims in the context of empirical findings is a valuable practice, yet extremely time-consuming for researchers. Such interpretation requires identifying key results (often captured in tables and figures) that provide supporting evidence from research papers, and contextualizing these results with associated methodological details (e.g., measures, sample, etc.). During the previous version of this shared task in 2024, we released datasets to support the development of methods for automatic identification of key result figures or tables as well as additional grounding context to make claim interpretation more efficient. However, the released datasets contained tables and images already extracted from the scientific papers to allow participants to bypass PDF pre-processing issues. In Context 2025, given recent advances in multimodal LLMs, we plan to extend the difficulty of this task by requiring participants to identify key results from paper PDFs directly, and add a new sub-task on multi-hop reasoning over scientific evidence. Organizers: Joel Chan, Matthew Akamatsu, Aakanksha Naik Scientific Visual Question Answering (SciVQA) Scholarly articles convey valuable information not only through unstructured text but also via (semi-)structured figures such as charts and diagrams. Automatically interpreting the semantics of knowledge encoded in these figures can be beneficial for downstream tasks such as question answering (QA). In the SciVQA challenge, the participants will develop multimodal systems capable of efficiently processing both visual (i.e., addressing attributes such as colour, shape, size, etc.) and non-visual QA pairs based on images of scientific figures and their captions. Organizers: Ekaterina Borisova, Georg Rehm Scientific Fact-checking of Social Media Posts on Climate Change (ClimateCheck) The ClimateCheck shared task focuses on fact-checking claims from social media about climate change against peer-reviewed scholarly articles. Participants will retrieve relevant publications from a corpus of 400,000 climate research articles and classify each abstract as supporting, refuting, or not having enough information about the claim. Training data will include human-annotated claim-publication pairs, and the evaluation will combine nDCG@K and Bpref for retrieval and F1 score for classification. The task aims to develop models that link social media claims to scientific evidence, promoting informed and evidence-based discussions on climate change. Organizers: Raia Abu Ahmad, Georg Rehm Software Mention Detection in Scholarly Publications (SOMD 25) Software plays an essential role in computational research methods and is considered one of the crucial entities in scholarly documents. However, software mentions are not always cited in academic documents, resulting in various informal mentions of software across a paper. Automatic identification of such software mention contributes to the better understanding, accessibility, and reproducibility of the research work. In addition to the mention of software, to understand the research context, it is necessary to understand the purpose of a software mention and its attributes, making software mention detection a comprehensive task. We are extending our first iteration of the shared task SOMD 2024 <https://nfdi4ds.github.io/nslp2024/docs/somd_shared_task.html> with new challenges. In addition to information extraction techniques, our extended focus would be on Joint Named Entity and Relation Classification techniques. Organizers: Sharmila Upadhyaya, Frank Krueger, Stefan Dietze SciHal2025: Hallucination Detection for Scientific Content Generative AI-enhanced academic research assistants are transforming how research is conducted. By allowing users to pose research-related questions in natural language, these systems can generate structured and concise summaries supported by relevant references. However, hallucinations — unsupported claims introduced by large language models — remain a significant obstacle to fully trusting these automatically generated scientific answers. Organizing Committee Tirthankar Ghosal, Oak Ridge National Laboratory, USA Philipp Mayr, GESIS – Leibniz Institute for the Social Sciences, Germany Aakanksha Naik, Allen Institute for AI, USA Amanpreet Singh, Allen Institute for AI, USA Anita de Waard, Elsevier, Netherlands Dayne Freitag, SRI International, USA Georg Rehm, German Research Center for Artificial Intelligence (DFKI), Germany Sonja Schimmler, Fraunhofer FOKUS, Germany Dan Li, Elsevier, Netherlands

1 0