April 2024 - Corpora

Job opportunities: 8 Postdoctoral & doctoral positions with different areas of focus
by Mahlberg, Agnes Michaela 29 Apr '24

29 Apr '24

Dear all, I have just started a new position as Humboldt Chair in Digital Humanities at Friedrich-Alexander-Universität Erlangen-Nürnberg in Germany and I am looking for researchers with a range of interests and expertise in language, computing and the digital world. I currently have 8 jobs to offer at postdoctoral level or at doctoral level. If you are interested in an exciting position, please do read on. If you know of potential candidates, please do share widely! What are the jobs about? Join a team of researchers who will be tackling an ambitious programme of innovative research looking at various aspects of language in today´s digital world. Specific project strands will develop computational, corpus, and statistical methods and software, topic-focused projects will be in digital environmental humanities, digital literary and cultural history, digitally supported storytelling and creative writing. In your cover letter, please specify which of these focus areas you are applying for. Depending on your qualifications and experience there are different options of appointment. Type of positions PhD positions are for up to 3 years (65% or 100%) Postdoctoral positions are initially for 2 years (100%), with the opportunity for extension after successful completion of that period. For more information see: https://www.jobs.fau.de/jobs/doctoral-or-postdoctoral-researchers-in-digita… Application deadline 17 May 2024 How to apply I´m very happy to take informal enquiries at this email address. Please send your application to dhss-kontakt(a)fau.de<mailto:dhss-kontakt@fau.de> (in PDF format, as a single document). The application has to include a cover letter (stating the area of focus that you are applying for), an academic CV, and evidence of all relevant qualifications. The first round of interviews will likely take place in the week beginning 3rd June. All the best Michaela -- Professor Michaela Mahlberg https://michaelamahlberg.com/ Humboldt Chair in Digital Humanities Head of Department Digital Humanities and Social Studies (DHSS)<https://www.dhss.phil.fau.de/> Friedrich-Alexander-Universität Erlangen-Nürnberg<https://www.fau.de/> Werner-von-Siemens-Str. 61 91052 Erlangen, Germany Editor of the International Journal of Corpus Linguistics https://benjamins.com/catalog/ijcl Host of the Life and Language Podcast https://anchor.fm/michaela-mahlberg/ @MichaMahlberg<https://twitter.com/MichaMahlberg> https://www.linkedin.com/in/michaela-mahlberg/

1 0

Edge Hill Corpus Research Group – Meeting #12
by Costas Gabrielatos 28 Apr '24

28 Apr '24

The next meeting of the Edge Hill Corpus Research Group will take place online (via MS Teams) on Thursday 25 April 2024, 2:00-3:30 pm (UK time). Registration closes tomorrow (Wednesday 24 April), 11 am. Attendance is free. You can register here: https://store.edgehill.ac.uk/conferences-and-events/conferences/events/edge… Topics: Corpus Methodology, Large Language Models Speakers: Sylvia Jaworska<https://www.reading.ac.uk/elal/staff/dr-sylvia-jaworska> (University of Reading, UK) & Mathew Gillings<https://www.wu.ac.at/ebc/about-us/team/mathew-gillings/> (Vienna University of Economics and Business, Austria) Title: How humans vs. machines identify discourse topics: an exploratory triangulation Abstract Identifying discourses and discursive topics in a set of texts has not only been of interest to linguists, but to researchers working across social sciences. Traditionally, these analyses have been conducted based on small-scale interpretive analyses of discourse which involve some form of close reading. Naturally, however, that close reading is only possible when the dataset is small, and it leaves the analyst open to accusations of bias and/or cherry-picking. Designed to avoid these issues, other methods have emerged which involve larger datasets and have some form of quantitative component. Within linguistics, this has typically been through the use of corpus-assisted methods, whilst outside of linguistics, topic modelling is one of the most widely-used approaches. Increasingly, researchers are also exploring the utility of LLMs (such as ChatGPT) to assist analyses and identification of topics. This talk reports on a study assessing the effect that analytical method has on the interpretation of texts, specifically in relation to the identification of the main topics. Using a corpus of corporate sustainability reports, totalling 98,277 words, we asked 6 different researchers, along with ChatGPT, to interrogate the corpus and decide on its main ‘topics’ via four different methods. Each method gradually increases in the amount of context available. • Method A: ChatGPT is used to categorise the topic model output and assign topic labels; • Method B: Two researchers were asked to view a topic model output and assign topic labels based purely on eyeballing the co-occurring words; • Method C: Two researchers were asked to assign topic labels based on a concordance analysis of 100 randomised lines of each co-occurring word; • Method D: Two researchers were asked to reverse-engineer a topic model output by creating topic labels based on a close reading. The talk explores how the identified topics differed both between researchers in the same condition, and between researchers in different conditions shedding light on some of the mechanisms underlying topic identification by machines vs humans or machines assisted by humans. We conclude with a series of tentative observations regarding the benefits and limitations of each method along with suggestions for researchers in selecting an analytical approach for discourse topic identification. While this study is exploratory and limited in scope, it opens up a way for further methodological and larger scale triangulations of corpus-based analyses with other computational methods including AI. ________________________________ Edge Hill University<http://ehu.ac.uk/home/emailfooter> Modern University of the Year, The Times and Sunday Times Good University Guide 2022<http://ehu.ac.uk/tef/emailfooter> University of the Year, Educate North 2021/21 ________________________________ This message is private and confidential. If you have received this message in error, please notify the sender and remove it from your system. Any views or opinions presented are solely those of the author and do not necessarily represent those of Edge Hill or associated companies. Edge Hill University may monitor email traffic data and also the content of email for the purposes of security and business communications during staff absence.<http://ehu.ac.uk/itspolicies/emailfooter>

2 2

Joint Workshop on Multiword Expressions and Universal Dependencies (MWE-UD 2024): Call for Participations
by Aaron Poet 26 Apr '24

26 Apr '24

Call4Participations: MWE-UD2024 Joint Workshop on Multiword Expressions and Universal Dependencies (MWE-UD 2024): Call for Participations Colocated with: LREC-COLING 2024 <https://lrec-coling-2024.org/> (Torino, Italia) Date of the Workshop: May 25, 2024 Organised and sponsored by: The Special Interest Group on the Lexicon (SIGLEX <http://www.siglex.org/>) of the Association for Computational Linguistics (ACL <https://www.aclweb.org/portal/>), SIGLEX’s Multiword Expressions Section ( SIGLEX-MWE <https://multiword.org/organization/constitution.html>), Universal Dependencies (UD <https://universaldependencies.org/>) and UniDive <https://unidive.lisn.upsaclay.fr/> Cost Action CA21167. ------------------------------ Exciting News - Initial program available with invited speakers and accepted archival and non-archival papers. ------------------------------ Contents on this page - Keynote Speakers <https://multiword.org/mweud2024/#keynotes> - Accepted Papers <https://multiword.org/mweud2024/#accepted> - Description <https://multiword.org/mweud2024/#description> - Organizing Committee <https://multiword.org/mweud2024/#organizers> - Program Committee <https://multiword.org/mweud2024/#committee> - Sponsors and Support <https://multiword.org/mweud2024/#sponsors> - Anti-harassment Policy <https://multiword.org/mweud2024/#antiharassment> - Contact <https://multiword.org/mweud2024/#contact>

1 0

Second CFP: 1st UniDive training Summer School 2024
by Atul K. Ojha 26 Apr '24

26 Apr '24

1st UniDive Training Summer School 2024 Dates: *8 — 12 July 2024* Location: *Technical University of Moldova*, Chișinău, Moldova Coordinating Project: UNIDIVE <https://unidive.lisn.upsaclay.fr/doku.php?id=start> (Universality, Diversity and Idiosyncrasy in Language Technology) Website: https://unidive.lisn.upsaclay.fr/doku.php?id=meetings:other-events:1st_unid… Cost: *Participants selected on the basis of their application will be reimbursed, details are below.* *Apply by:* *May 01, 2024* CALL FOR APPLICATIONS We are happy to announce the 1st edition of UNIDIVE Summer School on Universality, Diversity and Idiosyncrasy in Language Technology. It is dedicated mainly (but not exclusively) to young researchers and investigators. Researchers working on low-resourced languages, dialects and varieties are particularly welcome SUMMER SCHOOL ACTIVITIES - Annotation of Universal Dependencies treebank for a new language - a course by Sylvain Kahane (Université Paris Nanterre, France) and Francis Tyers (Indiana University, USA) - Annotation of multiword expressions in a new language - course by Verginica Mititelu (Romanian Academy) and Voula Giouli (Aristotle University of Thessaloniki and ILSP, ATHENA RC, Greece) - Corpus annotation infrastructure (annotation platforms, format validators, Git etc.) - a course by Daniel Zeman (Charles University, Czechia), Bruno Guillaume (LORIA, France) and Agata Savary (Université Paris-Saclay, France) - A brainstorming hackathon on topics submitted by the trainees - Poster sessions APPLICATIONS AND SUBMISSION GUIDELINES Each applicant should *submit a project* for a construction of a resource related to the topics of the training school (e.g. a new/enhanced UD treebank, a new PARSEME corpus, a resource adding a new annotation layer on top of a UD/PARSEME corpus, etc.). The length of the application should be 2 pages (excluding references). The application should contain: - The title - Applicant’s name and affiliation (including the country) - A list of 3-4 key-words - Description of a resource related to the topics of the training school - Explanation how the participation in the training school will be useful for the project - Open questions related to the project which could be addressed during the brainstorming hackathon - Short statement of the project phase (planning, started, in the process of creation) The projects are to be submitted via the OpenReview <https://openreview.net/group?id=UniDive/2024/Training_School> portal. TRAINEE’S SELECTION CRITERIA We can fund at least 40 trainees, the selection criteria include: - Trainee’s country: trainees only from COST countries[1] <#m_5787468061823227072_m_-5162026155145348429__ftn1> and Near-Neighbour Countries can be funded. See here <https://www.cost.eu/about/members/> and here <https://www.cost.eu/about/strategy/international-collaboration/>. - Age: Young Researchers and Investigators, i.e. under the age of 40, are promoted - Gender and geographical balance (notably between Inclusiveness Target Countries and others COST countries) - Relevance and quality of the project submitted by the trainee - Status of the language on which the trainee intends to work (low-resourced languages, dialects or varieties are promoted) *If you are not selected on the basis of these criteria and you can find other financial sources to cover your travel, accommodation and meals, you are also welcome to participate. * *The authors of the selected projects may optionally present them in a poster session during the Training School. * IMPORTANT DATES Deadline for project submission: May 01, 2024 Notification of acceptance: May 15, 2024 Summer school: July 8-12, 2024 For any inquiry, please contact the organisers at: victoria.bobicev(a)ia.utm.md Looking forward to seeing you in Moldova, Organizing Committee ------------------------------ [1] <#m_5787468061823227072_m_-5162026155145348429__ftnref1> COST members include 3 categories: COST Full Members, COST Cooperating Members (Israel), COST Partner Members (South Africa).

1 0

Job offer: Position as research assistant in the DFG project "ENTAILab - Research Infrastructure and Innovation Laboratory" at Goethe University Frankfurt - Application deadline: 14.05.2024
by Andy Lücking 26 Apr '24

26 Apr '24

***Apologues or cross-postings*** At the Institute of Computer Science (Prof. Dr. Alexander Mehler, TTLab, https://www.texttechnologylab.org/), Department of Computer Science and Mathematics at Goethe University Frankfurt, two PhD positions for Research Assistants (m/f/d) (E 13 TV-G-U, 75% part-time) are available at the next possible date for a period of three years within the project ENTAILab - Research Infrastructure and Innovation Laboratory. The two positions can be divided into one full-time and one 50% position by mutual agreement. The project is part of the Infrastructure Priority Programme New Data Spaces for the Social Sciences (SPP 2431, see https://www.new-data-spaces.de/en-us/), which is funded by the German Research Foundation (DFG). The salary group classification is based on the job characteristics determined by the collective labour agreement in effect for the Goethe University (TV-G-U). The aim of the project is to establish a research-oriented infrastructure for new types of data in survey research. To this end, a method-oriented innovation laboratory for novel methods in survey research is to be set up, which will develop and test methods of machine learning and artificial intelligence in cooperation with the projects of the SPP. The subject of the methods to be developed is multimodal data and therefore not primarily or exclusively linguistic research data. The applicant is expected to contribute to the project and actively participate in the workshops and events of the SPP. We are looking for a highly qualified individual with a strong interest in working in the field of cutting-edge research infrastructures, and in team-oriented development and application of innovative, research-oriented methods in the field of survey research and social sciences. With the SPP New Data Spaces for the Social Sciences and the Text-Technology Lab, in which the position will be embedded, we offer two research-oriented, internationally focused working environments in the fields of computational humanities, multimodal computing, machine learning and artificial intelligence. This includes funding for conference attendance and individual career development. Requirements: • Completed academic university degree (Master's) in a relevant subject with a focus on information science. • Very good English language skills (C1). • Demonstrable experience with databases and methods of machine learning or artificial intelligence. • Extensive programming skills in Java, Python or similar. • Knowledge of virtualization technologies such as Docker, Kubernetes or similar. • An interest in social science issues is desirable. Please send your application with the usual documents (cover letter, CV, copies of certificates) electronically in a summarized PDF document by 14.05.2024 to Prof. Dr. Alexander Mehler: mehler(a)em.uni-frankfurt.de.

1 0

Position as research assistant in the DFG project " FACES – Feasibility, Acceptance, and Data Quality of New Multimodal Surveys" at Goethe University Frankfurt - Application deadline: 14.05.2024
by Andy Lücking 26 Apr '24

26 Apr '24

***Apologies for cross-postings*** At the Institute of Computer Science (Prof. Dr. Alexander Mehler, TTLab, https://www.texttechnologylab.org/), Department of Computer Science and Mathematics at Goethe University Frankfurt, a PhD position for a Research Assistant (m/f/d) (E 13 TV-G-U) is available at the next possible date for a period of three years within the project FACES – Feasibility, Acceptance, and Data Quality of New Multimodal Surveys. The project is part of the Infrastruc-ture Priority Programme New Data Spaces for the Social Sciences (SPP 2431, see https://www.new-data-spaces.de/en-us/), which is funded by the German Research Foundation (DFG). The salary group classification is based on the job characteristics determined by the collective labour agreement in effect for the Goethe University (TV-G-U). The aim of the project is to develop and test an interview model in the context of survey research, data analysis methods for automatic interview modelling and the development of avatar technologies for Virtual Reality (VR) and Augmented Reality (AR) -supported interviews in survey research. Finally, a virtualized embodied interviewer will be developed and tested on this basis. The applicant will be expected to contribute to the project and actively participate in the workshops and events of the SPP. We are looking for a highly qualified individual with a strong interest in working in the field of cutting-edge research methods, especially in the area of NLP and Virtual Reality, and in team-oriented development and application of innovative, research-oriented methods in the field of survey research and social sciences. With the SPP New Data Spaces for the Social Sciences and the Text-Technology Lab, in which the position will be embedded, we offer two research-oriented, internationally focused working environments in the fields of computational humanities, multimodal computing, machine learning and artificial intelligence. This includes funding for conference attendance and individual career development. Requirements: • Completed academic university degree (Master's) in a relevant subject with a focus on information science. • Very good English language skills (C1). • Demonstrable experience in the field of VR or AR systems and methods of machine learning or artificial intelligence. • Extensive programming skills in Java, Python or similar. • Extensive knowledge of C# and the use of Unity. • An interest in social science issues is desirable. Please send your application with the usual documents (cover letter, CV, copies of certificates) electronically in a summarized PDF document by 14.05.2024 to Prof. Dr. Alexander Mehler: mehler(a)em.uni-frankfurt.de.

1 0

Job offer: Position as research assistant in the DFG project " Semiautomated Thematic Text Classification as a Basis for Corpus Linguistic Value-Added Services" at Goethe University Frankfurt - Application deadline: 14.05.2024
by Andy Lücking 26 Apr '24

26 Apr '24

***Apologies for cross-postings*** At the Institute of Computer Science (Prof. Dr. Alexander Mehler, TTLab, https://www.texttechnologylab.org/), Department of Computer Science and Mathematics at Goethe University Frankfurt, a PhD position for a Research Assistant (m/f/d) (E 13 TV-G-U) is available at the next possible date for a period of three years within the project Semiautomated Thematic Text Classification as a Basis for Corpus Linguistic Value-Added Services. The project is funded by the German Research Foundation (DFG). The salary group classification is based on the job characteristics determined by the collective labour agreement in effect for the Goethe University (TV-G-U). The aim of the project is to develop a deep learning-based topic classification system using the Wikipedia category system and data from the Wikidata project, and to develop and test topic models based on this classification system for the automatic classification of texts, including those from the Leibniz Institute for the German Language (IDS) in Mannheim. The project will be carried out in cooperation with the IDS and the Saxon Academy of Sciences in Leipzig. The research will focus on state-of-the-art AI methods, in particular generative AI methods. The applicant is expected to engage in the project and actively participate in courses, workshops, and events of the project. We are looking for a highly qualified individual with a strong interest in research methods in the fields of AI and topic modeling as well as in the team-oriented development and application of innovative, research-oriented methods in the field of text modeling. With the Text-Technology Lab, in which the position will be embedded, we offer a research-oriented, internationally focused working environment in the fields of computational humanities, multimodal computing, machine learning and artificial intelligence. This includes funding for conference attendance and individual career development. Requirements: • Completed academic degree (Master's or equivalent) in computer science, computational humanities, computational linguistics or a field related to text modelling and AI. • Experience in the development and testing of NLP or AI methods. • Extensive programming knowledge in Java, Python or similar. • An interest in issues relating to information science is desirable but not essential. Please send your application with the usual documents (cover letter, CV, copies of certificates) electronically in a summarized PDF document by 14.05.2024 to Prof. Dr. Alexander Mehler: mehler(a)em.uni-frankfurt.de.

1 0

TrentoLogue - SemDial 2024: 2nd CfP
by Raffaella Bernardi 26 Apr '24

26 Apr '24

SemDial 2024 -- TrentoLogue The 28th Workshop on the Semantics and Pragmatics of Dialogue 11 and 12 September 2024 University of Trento, Italy https://tinyurl.com/3c7rracn TrentoLogue will be the 28th edition of the SemDial workshop series which aim to bring together researchers working on the semantics and pragmatics of dialogue in fields such as formal semantics and pragmatics, computational linguistics, artificial intelligence, philosophy, psychology, and neuroscience. Keynote speakers Uri Hasson, Princeton University Azzurra Ruggeri, Technical University Munich and CEU, Vienna Bernardo Magnini, Fondazone Bruno Kessler (FBK) # IMPORTANT DATES: * *Long paper submissions: May 26, 2024* * Reviews due to: June 24, 2024 * Notification for long papers: July 1, 2024 * Short paper submissions: July 11, 2024 * Notification for short papers: July 17, 2024 * Camera Ready: August 26, 2024 * Registration Deadline: August 27, 2024 Note: All deadlines are 11:59PM UTC-12:00 ("Anywhere on Earth"). #TOPICS We welcome submissions with formal, computational, and empirical approaches to the semantics and pragmatics of dialogue, including, but not limited to: * the dynamics of agents' information states in dialogue * common ground/mutual belief * goals, intentions, and commitments in communication * turn-taking and interaction control * semantic/pragmatic interpretation in dialogue * dialogue and discourse structure * categorization of dialogue phenomena in corpora * child-adult interaction * language learning through dialogue * gesture, gaze, and intonational meaning in communication * multimodal dialogue * interpretation and reasoning in spoken dialogue systems * dialogue management * designing and evaluating dialogue systems * modelling miscommunication, disfluency, and repair * dialogue/interaction studies from a psychological perspective * neuroscience of dialogue * Interactivist approaches to dialogue * animal communication # SUBMISSION INSTRUCTIONS: Long papers: Authors should submit an anonymous paper of at most 8 pages of content (up to 2 additional pages are allowed for references). Short papers: Authors should submit a non-anonymized paper of at most 2 pages of content (up to 1 additional page allowed for references). Submissions to this track can be non-archival on request. Submissions should be pdf files and use the LaTeX or Word ( https://github.com/acl-org/acl-style-files) templates provided for ACL. Concurrent submission policy: Papers that have been or will be submitted to other meetings or publications must provide this information, using a footnote on the title page of the submissions. SemDial 2024 cannot accept work for publication or presentation that will be (or has been) published elsewhere. Submission is electronic, using the EasyChair conference management system at our Easychair submission site https://easychair.org/conferences/?conf=semdial2024trentolog Organizing Committee Raffaella Bernardi Vanessa Maria Caleca Jakub Szymanik Roberto Zamparelli Programme Committee Chairs Raffaella Bernardi, University of Trento Ellen Breitholtz, University of Gothenburg Giuseppe Riccardi, University of Trento TrentoLogue is endorsed by SIGdial and SIGsem. ============================================================== University of Trento CIMeC: C225, second floor, Corso Bettini 31, 38068 Rovereto (TN), DISI: Povo 2, Room: 110, Via Sommarive 9, I 38123, Povo (TN) Tel. +39 0464 80 8704 (CIMeC) http://disi.unitn.it/~bernardi/ ==============================================================

1 0

Call for Papers: Industry Track at EMNLP 2024
by dpreotiucpie＠bloomberg.net 26 Apr '24

26 Apr '24

Industry Track @ The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP) Hyatt Regency Miami Hotel, Miami, Florida (United States) 12 - 14 November 2024 *Website:* https://2024.emnlp.org/calls/industry_track/ *Submission Link:* https://openreview.net/group?id=EMNLP/2024/Industry_Track *Submission Deadline*: 18 July 2024 ==== Goal ==== Language technologies and their applications are an integral and critical part of our daily lives. The development of many of these technologies trace their roots to academic and industrial research laboratories where researchers invented a plethora of algorithms, benchmarked them against shared datasets and perfected the performance of these algorithms to provide plausible solutions to real-world applications. The EMNLP 2024 Industry Track aims to highlight this mutual influence of language technology in academia and industry, which has significantly contributed to the proliferation of industrial applications. The track provides the opportunity for researchers, engineers, practitioners and users to meet and discuss the latest language technologies methods as deployed in a real-world setting and aims to be the premier forum for knowledge sharing across the boundary between academia and industry. We acknowledge the unique difficulties encountered when adapting language technologies for building novel and robust real-world applications as the journey from theoretical research to practical deployment is fraught with new challenges. These range from the technical aspects of system deployment and optimizing for efficiency, to making informed design choices or methodological considerations of incorporating human feedback and oversight. To provide a forum to address these multifaceted issues, we are seeking submissions that not only delve into research but also demonstrate the application of systems in real-world scenarios, irrespective of whether they involve proprietary data. Contributions are invited across all spectrums of language technologies and systems, with a special emphasis on innovations and implementations that hold relevance to real-world applications. We encourage submissions from both non-profit and for-profit sectors, with the understanding that the end-users of these systems extend beyond the NLP community. Please note that if submissions involve proprietary data, there is no requirement to make this data available. ============= Topics of Interest ============= The EMNLP 2024 Industry Track provides the opportunity to highlight the key insights and new research challenges that arise from the development and deployment of real-world applications using language technologies. Relevant areas include: **System design, efficiency, maintainability and scalability** of real-world applications, with topics in alphabetical order including, but not limited to: - Benchmarks and methods for improving the latency and efficiency of systems - Continuous maintenance and improvement of deployed systems - Efficient methods for training and inference - Enabling infrastructure for large-scale deployment - Human-in-the-Loop approaches to application development - Implementation at speed, scale or low-cost - System combination **Novel applications and use cases**, with topics in alphabetical order including, but not limited to: - Best practices, lessons learned or a vision on deploying real-world applications - Case studies, from design to deployment - Description of an application or system - Design of application-relevant datasets - Development of methods under system constraints (model or data size) - Novel NLP applications **Methods for deployed systems**, with topics in alphabetical order including, but not limited to: - Ethics, bias, fairness and harmlessness - Interpretability - Interactive systems - Offline and online system evaluation methodologies - Online learning - Robustness ============ Important Dates ============ Paper submission deadline: July 18, 2024 Notification: October 1, 2024 Camera-ready version of papers due: October 15, 2024 Main conference: 12 - 14 November 2024 Note: All deadlines are 11:59PM UTC-12:00 (“anywhere on Earth”). Following the ACL and ARR Policies for Review and Citation, updated in early 2024, there is no anonymity period requirement, e.g. one may upload the paper to arXiv at any time. ========== Submissions ========== Authors are invited to submit original papers that are not previously published, accepted to be published, or under consideration for publication in any other forum. Submissions will be reviewed in a double-blind manner and assessed based on their novelty, technical quality, potential impact, and clarity. Submissions to the EMNLP 2024 Industry Track should emphasize real-world implementations of natural language processing systems, the development of such systems, or provide insights based on real-world datasets with obvious industry impact. For papers that rely heavily on empirical evaluations, the experimental methods and results should be clear, well executed, and repeatable (though the data may be proprietary). Industry Track papers cannot exceed 6 pages in length; however, references do not count toward the page limit, nor do the following optional sections: acknowledgments (only in the final version), ethical considerations, and appendices. Visit https://2024.emnlp.org/calls/industry_track/ for more information. ================ Industry Track Chairs ================ Franck Dernoncourt (Adobe Research) Daniel Preoțiuc-Pietro (Bloomberg) Anastasia Shimorina (Orange) Contact: emnlp2024-industry-track(a)googlegroups.com

1 0

FEVER shared task at EMNLP 2024
by A. Vlachos 26 Apr '24

26 Apr '24

Dear all, We are excited to announce our next shared task of the FEVER Workshop at EMNLP2024, which aims to evaluate the ability of systems to verify real-world claims with evidence from the Web. More explicitly: * Given a claim and its metadata, the systems must retrieve evidence that supports and/or refutes the claim, either from the Web or from the document collection provided by the organisers. * Using this evidence, label the claim as Supported, Refuted given the evidence, Not Enough Evidence (if there isn't sufficient evidence to either support or refute it) or Conflicting Evidence/Cherry-picking (if the claim has both supporting and refuting evidence). * A response will be considered correct only if both the label is correct and the evidence adequate. As evidence retrieval evaluation is non-trivial to perform automatically, the participants will asked to help evaluate it manually to assess the systems fairly. To learn more about the task and our baseline implementation, read our paper AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Web<https://proceedings.neurips.cc/paper_files/paper/2023/hash/cd86a30526cd1aff…>. Key dates: * Challenge Launch: April 2024 * Training/Dev Data Release: April 2024 * Testing Begins: June 30, 2024 * Submission Closes: July 15, 2024 * Results Announced: July 18, 2024 * System Descriptions Due for Workshop: August 15, 2024 * Winners Announced: November 15 or 16, 2024 (7th FEVER Workshop) For more information on the shared task, data and code to get started, visit https://fever.ai/<https://fever.ai/task.html>task<https://fever.ai/task.html>.html<https://fever.ai/task.html>. Feel free to contact us on our slack channel<https://join.slack.com/t/feverworkshop/shared_invite/zt-4v1hjl8w-Uf4yg~dift…> or via email: fever-organisers(a)googlegroups.com with any questions. Looking forward to your participation! -- The FEVER workshop organizers

1 0