- Corpora - ELRA lists

Second Call for Participation- IWSLT 2023
by Atul K. Ojha 10 Jan '23

10 Jan '23

Apologies for cross-posting. ---------------------------------------- *The International Conference on Spoken Language Translation* ACL – 20th IWSLT 2023 July 13-14, 2023 – Toronto, Canada http://iwslt.org The International Conference on Spoken Language Translation (IWSLT) is the premier annual conference for all aspects of Spoken Language Translation. Every year, the conference organizes and sponsors open evaluation campaigns around key challenges in simultaneous and consecutive translation, under real-time/low latency or offline conditions and under low-resource or multilingual constraints. System descriptions and results from participants’ systems and scientific papers related to key algorithmic advances and best practices are presented. IWSLT is the venue of the SIGSLTs, the Special Interest Group on Spoken Language Translation of ACL, ISCA and ELRA. With a track record of 19 years, IWSLT benchmarks and proceedings serve as references for all researchers and practitioners working on speech translation and related fields. In 2023, IWSLT will be co-located with ACL and will be run as a hybrid meeting. Important Dates January 14, 2023: Release of shared task training and dev data April 24, 2023: Scientific paper submission deadline April 01-15, 2023: Evaluation period May 22, 2023: Notification of acceptance June 06, 2023: Camera-ready paper due July 12, 2023: Pre-recorded video due July 13-14, 2023: Conference Evaluation IWSLT 2023 features shared tasks <https://iwslt.org/2023/#shared-tasks> that address the following focus areas: – Speech translation of talks – Speech-to-speech translation of multi-source data – Speech dubbing of multi-source data – Dialectal and Low-resource speech translation – Formality control for SLT Training and development data for each shared task will be prepared and released by the respective organizers (for further information on this initiative, please refer to the website). Participants will receive instructions about how to submit their runs. The results of all tasks will be collected and discussed in an overview paper that will be presented at the conference. In addition, participants have the opportunity to present their work through a system paper that will be published in the ACL Proceedings. Conference IWSLT also invites submissions of scientific papers to be published in the ACL Proceedings and presented either in oral or poster format. The conference selects high-quality, original contributions on theoretical and practical issues of spoken language translation research, technologies and applications. Contact Please send an email to iwslt-evaluation-campaign(a)googlegroups.com if you have any questions related to the shared tasks. Thanks, Marcello, Alex, Jan, Sebastian, Elizabeth, Atul (IWSLT organisers)

1 0

JLC'23 at Grenoble (France) - 2nd CFP
by Marie-Paule Jacques 10 Jan '23

10 Jan '23

Dear Corpora members, Please find below a CFP for the next "Journées de la Linguistique de Corpus". * The 11th International Conference on Corpus Linguistics * 3-6 July 2023, Grenoble, France * Call for Papers * https://jlc2023.sciencesconf.org/ The International Conference on Corpus Linguistics (JLC), founded by Geoffrey Williams in 2001 at the University of South Brittany, Lorient, France, regularly draws together an interdisciplinary community whose research focus is corpus linguistics. After seven gatherings in Lorient and an interlude in Orleans in 2015 (8th International Conference on Corpus Linguistics), the conference alighted in Grenoble in early July 2017 and in November 2019, organized by the LIDILEM Laboratory with contributions from LIG, ILCEA4, Litt&Arts and the MSH-Alpes. Université Grenoble Alpes is honored to host this international conference again from July 3rd to July 6th 2023. The JLC’23 are organized in collaboration with other labs from French universities (Lyon, Montpellier, Toulouse): DDL, ICAR, Praxiling, CLLE. The objective of JLC'23 is to (re)unite a community that adopts various approaches, be they methodological or disciplinary, to promote corpus linguistics, and to contribute to the evolution of practices in the field by building bridges between different approaches to digital corpora. The participants are invited to share and compare their knowledge of tools, experiences, and findings. In the tradition of previous conferences, the JLC in Grenoble will offer three days of presentations, guest speakers and discussion sessions among the participants. Training sessions on tools and methods will be organized over a half day. This edition of the JLC will put a particular focus on corpora and didactics. A part of the conference will be specifically dedicated to this theme. We expect papers that show and question the use of corpora in teaching, be they feedback from real uses, presentation of methodological approaches for various audiences, or more theoretical points of view... These days will not be limited to this theme and will be open to all kinds of contributions on written, oral or multimodal corpora, which may concern, in a non-exhaustive way : 1. Linguistic approaches to corpora 2. Methods and tools 3. Variations, genres, and discourse 4. Applications and uses of corpora for teaching and learning, translation, terminology... Guest speakers include: Florence Mourlhon-Dallies + another speaker to be confirmed Submissions for a presentation or a demonstration in French or English should not exceed three pages (excluding figures and bibliographic references) and must be anonymous. They will get double peer-reviewing by members of the scientific board. JLC2023 will adopt the SciencesConf system to manage communication proposals. In addition to classic presentations, you may also propose a demonstration (identical submission guidelines). Publication: following the colloquium, authors are welcome to submit an article. This collection of articles will be reviewed and published online. Timetable: 1. First CFP: November 2022 2. Submission deadline: *Friday February 3rd 2023* 3. Notification of acceptance: Mid-April 2023 4. Final submission version: Friday May 19th 2023 5. Registration begins: May 2023 Best regards -- Marie-Paule Jacques /Mobilisée pour la défense du service public de l'enseignement supérieur et de la recherche/ Maitre de conférences HDR Sciences du langage - Senior Lecturer in Linguistics INSPE et LIDILEM (Laboratoire de linguistique et didactique des langues étrangères et maternelles) Université Grenoble Alpes

1 0

First Call For Papers and Participation: BioNLP 2023 and BioNLP Shared Tasks 2023 (co-located with ACL 2023)
by dina demner 10 Jan '23

10 Jan '23

BIONLP 2023 and Shared Tasks @ ACL 2023 https://aclweb.org/aclwiki/BioNLP_Workshop#SHARED_TASKS_2023 *Tentative* Important Dates(All submission deadlines are 11:59 p.m. UTC-12:00 “anywhere on Earth”)May 1, 2023: Workshop Paper Due DateJune 15, 2023: Camera-ready papers dueBioNLP 2023 Workshop at ACL, July 13 OR 14, 2023, Toronto, Canada Please watch for the updates! SUBMISSION INSTRUCTIONS-----------------------------------------Two types of submissions are invited: full papers and short papers. Full papers should not exceed eight (8) pages of text, plus unlimited references. These are intended to be reports of original research. BioNLP aims to be the forum for interesting, innovative, and promising work involving biomedicine and language technology, whether or not yielding high performance at the moment. This by no means precludes our interest in and preference for mature results, strong performance, and thorough evaluation. Both types of research and combinations thereof are encouraged. Short papers may consist of up to four (4) pages of content, plus unlimited references. Appropriate short paper topics include preliminary results, application notes, descriptions of work in progress, etc. Electronic SubmissionSubmissions must be electronic and in PDF format, using the Softconf START conference management system Submissions need to be anonymous. *The submission site will be announced shortly.* Dual submission policy: papers may NOT be submitted to the BioNLP 2017 workshop if they are or will be concurrently submitted to another meeting or publication. WORKSHOP OVERVIEW AND SCOPE---------------------------------------------------The BioNLP workshop associated with the ACL SIGBIOMED special interest group has established itself as the primary venue for presenting foundational research in language processing for the biological and medical domains. The workshop is running every year since 2002 and continues getting stronger. BioNLP welcomes and encourages work on languages other than English, and inclusion and diversity. BioNLP truly encompasses the breadth of the domain and brings together researchers in bio- and clinical NLP from all over the world. The workshop will continue presenting work on a broad and interesting range of topics in NLP. The interest to biomedical language has broadened significantly due to the COVID-19 pandemic and continues to grow: as access to information becomes easier and more people generate and access health-related text, it becomes clearer that only language technologies can enable and support adequate use of the biomedical text. BioNLP 2023 will be particularly interested in language processing that supports DEIA (Diversity, Equity, Inclusion and Accessibility). The work on detection and mitigation of bias and misinformation continues to be of interest. Research in languages other than English, particularly, under-represented languages, and health disparities are always of interest to BioNLP. Other active areas of research include, but are not limited to: Tangible results of biomedical language processing applications;Entity identification and normalization (linking) for a broad range of semantic categories;Extraction of complex relations and events;Discourse analysis;Anaphora/coreference resolution;Text mining / Literature based discovery;Summarization;Τext simplification;Question Answering;Resources and strategies for system testing and evaluation;Infrastructures and pre-trained language models for biomedical NLP (Processing and annotation platforms);Development of synthetic data & data augmentation;Translating NLP research into practice;Getting reproducible results. SHARED TASKS 2023-------------------------------------Shared Tasks on Summarization of Clinical Notes and Scientific Articles The first task focuses on Clinical Text. Task 1A. Problem List SummarizationAutomatically summarizing patients’ main problems from the daily care notes in the electronic health record can help mitigate information and cognitive overload for clinicians and provide augmented intelligence via computerized diagnostic decision support at the bedside. The task of Problem List Summarization aims to generate a list of diagnoses and problems in a patient’s daily care plan using input from the provider’s progress notes during hospitalization.This task aims to promote NLP model development for downstream applications in diagnostic decision support systems that could improve efficiency and reduce diagnostic errors in hospitals. This task will contain 768 hospital daily progress notes and 2783 diagnoses in the training set, and a new set of 300 daily progress notes will be annotated by physicians as the test set. The annotation methods and annotation quality have previously been reported here. The goal of this shared task is to attract future research efforts in building NLP models for real-world decision support applications, where a system generating relevant and accurate diagnoses will assist the healthcare providers’ decision-making process and improve the quality of care for patients. Task 1B. Radiology report summarizationRadiology report summarization is a growing area of research. Given the Findings and/or Background sections of a radiology report, the goal is to generate a summary (called an Impression section) that highlights the key observations and conclusions of the radiology study. The research area of radiology report summarization currently faces an important limitation: most research is carried out on chest X-rays. To palliate these limitations, we propose two datasets: A shared summarization task that includes six different modalities and anatomies, totalling 79,779 samples, based on the MIMIC-III database.A shared summarization task on chest x-ray radiology reports with images and a brand new out-of-domain test-set from Stanford. SEE MORE at: https://vilmedic.app/misc/bionlp23/sharedtask Task 2. Lay Summarization of Biomedical Research ArticlesBiomedical publications contain the latest research on prominent health-related topics, ranging from common illnesses to global pandemics. This can often result in their content being of interest to a wide variety of audiences including researchers, medical professionals, journalists, and even members of the public. However, the highly technical and specialist language used within such articles typically makes it difficult for non-expert audiences to understand their contents. Abstractive summarization models can be used to generate a concise summary of an article, capturing its salient point using words and sentences that aren’t used in the original text. As such, these models have the potential to help broaden access to highly technical documents when trained to generate summaries that are more readable, containing more background information and less technical terminology (i.e., a “lay summary”). This shared task surrounds the abstractive summarization of biomedical research articles, with an emphasis on controllability and catering to non-expert audiences. Through this task, we aim to help foster increased research interest in controllable summarization that helps broaden access to technical texts and progress toward more usable abstractive summarization models in the biomedical domain. For more information, see: Main site: https://biolaysumm.org/CodaLab page - subtask 1: https://codalab.lisn.upsaclay.fr/competitions/9541CodaLab page - subtask 2: https://codalab.lisn.upsaclay.fr/competitions/9544 *Workshop Organizers* Dina Demner-Fushman, US National Library of Medicine Kevin Bretonnel Cohen, University of Colorado School of Medicine Sophia Ananiadou, National Centre for Text Mining and University of Manchester, UK Jun-ichi Tsujii, National Institute of Advanced Industrial Science and Technology, Japan

1 0

First Call For Papers and Participation: BioNLP 2023 and BioNLP Shared Tasks 2023 (co-located with ACL 2023)
by dina demner 10 Jan '23

10 Jan '23

BIONLP 2023 and Shared Tasks @ ACL 2023 https://aclweb.org/aclwiki/BioNLP_Workshop#SHARED_TASKS_2023 *Tentative* Important Dates (All submission deadlines are 11:59 p.m. UTC-12:00 “anywhere on Earth”) May 1, 2023: Workshop Paper Due Date June 15, 2023: Camera-ready papers due BioNLP 2023 Workshop at ACL, July 13 OR 14, 2023, Toronto, Canada Please watch for the updates! SUBMISSION INSTRUCTIONS ----------------------------------------- Two types of submissions are invited: full papers and short papers. Full papers should not exceed eight (8) pages of text, plus unlimited references. These are intended to be reports of original research. BioNLP aims to be the forum for interesting, innovative, and promising work involving biomedicine and language technology, whether or not yielding high performance at the moment. This by no means precludes our interest in and preference for mature results, strong performance, and thorough evaluation. Both types of research and combinations thereof are encouraged. Short papers may consist of up to four (4) pages of content, plus unlimited references. Appropriate short paper topics include preliminary results, application notes, descriptions of work in progress, etc. Electronic Submission Submissions must be electronic and in PDF format, using the Softconf START conference management system Submissions need to be anonymous. *The submission site will be announced shortly.* Dual submission policy: papers may NOT be submitted to the BioNLP 2017 workshop if they are or will be concurrently submitted to another meeting or publication. WORKSHOP OVERVIEW AND SCOPE --------------------------------------------------- The BioNLP workshop associated with the ACL SIGBIOMED special interest group has established itself as the primary venue for presenting foundational research in language processing for the biological and medical domains. The workshop is running every year since 2002 and continues getting stronger. BioNLP welcomes and encourages work on languages other than English, and inclusion and diversity. BioNLP truly encompasses the breadth of the domain and brings together researchers in bio- and clinical NLP from all over the world. The workshop will continue presenting work on a broad and interesting range of topics in NLP. The interest to biomedical language has broadened significantly due to the COVID-19 pandemic and continues to grow: as access to information becomes easier and more people generate and access health-related text, it becomes clearer that only language technologies can enable and support adequate use of the biomedical text. BioNLP 2023 will be particularly interested in language processing that supports DEIA (Diversity, Equity, Inclusion and Accessibility). The work on detection and mitigation of bias and misinformation continues to be of interest. Research in languages other than English, particularly, under-represented languages, and health disparities are always of interest to BioNLP. Other active areas of research include, but are not limited to: Tangible results of biomedical language processing applications; Entity identification and normalization (linking) for a broad range of semantic categories; Extraction of complex relations and events; Discourse analysis; Anaphora/coreference resolution; Text mining / Literature based discovery; Summarization; Τext simplification; Question Answering; Resources and strategies for system testing and evaluation; Infrastructures and pre-trained language models for biomedical NLP (Processing and annotation platforms); Development of synthetic data & data augmentation; Translating NLP research into practice; Getting reproducible results. SHARED TASKS 2023 ------------------------------------- Shared Tasks on Summarization of Clinical Notes and Scientific Articles The first task focuses on Clinical Text. Task 1A. Problem List Summarization Automatically summarizing patients’ main problems from the daily care notes in the electronic health record can help mitigate information and cognitive overload for clinicians and provide augmented intelligence via computerized diagnostic decision support at the bedside. The task of Problem List Summarization aims to generate a list of diagnoses and problems in a patient’s daily care plan using input from the provider’s progress notes during hospitalization.This task aims to promote NLP model development for downstream applications in diagnostic decision support systems that could improve efficiency and reduce diagnostic errors in hospitals. This task will contain 768 hospital daily progress notes and 2783 diagnoses in the training set, and a new set of 300 daily progress notes will be annotated by physicians as the test set. The annotation methods and annotation quality have previously been reported here. The goal of this shared task is to attract future research efforts in building NLP models for real-world decision support applications, where a system generating relevant and accurate diagnoses will assist the healthcare providers’ decision-making process and improve the quality of care for patients. Task 1B. Radiology report summarization Radiology report summarization is a growing area of research. Given the Findings and/or Background sections of a radiology report, the goal is to generate a summary (called an Impression section) that highlights the key observations and conclusions of the radiology study. The research area of radiology report summarization currently faces an important limitation: most research is carried out on chest X-rays. To palliate these limitations, we propose two datasets: A shared summarization task that includes six different modalities and anatomies, totalling 79,779 samples, based on the MIMIC-III database. A shared summarization task on chest x-ray radiology reports with images and a brand new out-of-domain test-set from Stanford. SEE MORE at: https://vilmedic.app/misc/bionlp23/sharedtask Task 2. Lay Summarization of Biomedical Research Articles Biomedical publications contain the latest research on prominent health-related topics, ranging from common illnesses to global pandemics. This can often result in their content being of interest to a wide variety of audiences including researchers, medical professionals, journalists, and even members of the public. However, the highly technical and specialist language used within such articles typically makes it difficult for non-expert audiences to understand their contents. Abstractive summarization models can be used to generate a concise summary of an article, capturing its salient point using words and sentences that aren’t used in the original text. As such, these models have the potential to help broaden access to highly technical documents when trained to generate summaries that are more readable, containing more background information and less technical terminology (i.e., a “lay summary”). This shared task surrounds the abstractive summarization of biomedical research articles, with an emphasis on controllability and catering to non-expert audiences. Through this task, we aim to help foster increased research interest in controllable summarization that helps broaden access to technical texts and progress toward more usable abstractive summarization models in the biomedical domain. For more information, see: Main site: https://biolaysumm.org/ CodaLab page - subtask 1: https://codalab.lisn.upsaclay.fr/competitions/9541 CodaLab page - subtask 2: https://codalab.lisn.upsaclay.fr/competitions/9544 *Workshop Organizers* Dina Demner-Fushman, US National Library of Medicine Kevin Bretonnel Cohen, University of Colorado School of Medicine Sophia Ananiadou, National Centre for Text Mining and University of Manchester, UK Jun-ichi Tsujii, National Institute of Advanced Industrial Science and Technology, Japan

1 0

Final Call for Papers - Workshop on Language-Based AI Agent Interaction with Children
by Maike Paetzel-Prüsmann 09 Jan '23

09 Jan '23

Workshop on Language-Based AI Agent Interaction with Children https://aichildinteraction.github.io/ February 21st, 2023, in Los Angeles, USA & Virtual (Hybrid Format) Paper Submission Deadline: January 13th, 2023 (extended) Easychair: https://easychair.org/conferences/?conf=aiaic23 Contact: https://groups.google.com/g/ai-child-interactions or aichildinteraction(a)gmail.com More information about registering to our workshop for those not attending IWSDS will be shared in a separate call for participation closer to the workshop day. =================================================== In this workshop, we aim to bring together researchers looking into multimodal interactions between children and artificial agents to discuss research problems that center around interactivity and go beyond just processing child speech. We are interested in discussing approaches to collecting and annotating datasets involving child speech, intent classification in child speech, designing dialogue flow with artificial agents that primarily interact with children, as well as repair strategies, active listening behavior, and other aspects of dialogue modeling. Moreover, multiparty conversations involving several children, children, and their adult caregivers or several artificial agents are of particular interest to this workshop. Acknowledging the early-stage nature of research in this area, the workshop will invite short position papers as contributions. In addition to selected talks that will be invited based on the submitted papers, we will host roundtable discussions allowing attendees to discuss ideas, share challenges they have faced, and highlight ideas for future research.  ## Topics of Interest The workshop welcomes contributions across a wide range of topics including, but not limited to: Natural Language Understanding of Child Speech  Dialogue Modeling of Child-Agent, Child-Robot, Child-Child, and Child-Adult Speech  Conversational Flow and Repair in Dialogue with Children  Multiparty-Interaction Involving Children  Multimodal Processing of Child Interactions  Automatic Speech Recognition of Child Speech  Evaluating Child Interactions with Artificial Agents/Robots Challenges in Designing Interactions for Children  Datasets of Child-Child, Child-Adult, or Child-Agent/Robot Interaction Ethics and Responsible AI for Child-Agent/Robot Interaction Related Topics ## Important Dates - Paper submission deadline: January 13th, 2023 (extended) - Author Notification deadline: February 1st, 2023 - Workshop: February 21st, 2023 (morning session) ## Submission Guidelines We invite short position papers of 3-4 pages (plus additional pages for references and appendices without page limitation), including work in progress containing preliminary results, technical reports, case studies, surveys, and state-of-the-art research in language-based AI agent interactions with children. Recently submitted or published papers are welcome to be submitted to this workshop if they are highly relevant to the topic of the workshop. Please select the appropriate track during the EasyChair submission to mark the submission accordingly. Papers will be reviewed for their relevance, novelty, and scientific and technical soundness. Submissions do not need to be anonymized for review. All manuscripts must be written in English and submitted electronically in PDF format via EasyChair: https://easychair.org/conferences/?conf=aiaic23 Accepted papers will be published on the workshop website. However, papers are still considered non-archival and can be submitted to other conferences. Authors of accepted papers are expected to present their paper during the workshop in the form of a short talk, which can either be given in person in Los Angeles, USA, or virtually via Zoom. Authors should use the official IWSDS template: Latex Style and Template: https://drive.google.com/open?id=1mnzjvTlIVEsdPb2IZXbzxU8WRJj3mLiJ Overleaf: https://www.overleaf.com/read/djcrwzgrdjvj Word Template: https://drive.google.com/open?id=1WmO9iLvJtO0cH1E0VSC1bPsC0vRDpzbd ## Participation Participation in our workshop will be possible online or in person in Los Angeles. If you are planning on attending IWSDS, then you can register for the conference here: https://sites.google.com/view/iwsds2023/registration Registration to the main conference includes the workshop participation. If you would like to participate in our workshop only, please wait for further instructions on the registration process, which we will share in a separate call for participation closer to the workshop day. ## Contact If you have questions, please get in touch via our public Google Group https://groups.google.com/g/ai-child-interactions or by sending an e-mail to aichildinteraction(a)gmail.com

1 0

2nd CFP: Special Issue on The Role of Context in Neural Machine Translation Systems and its Evaluation
by Knowles, Rebecca 09 Jan '23

09 Jan '23

*Apologies for cross-posting* [image.png] Second CFP: Special Issue on The Role of Context in Neural Machine Translation Systems and its Evaluation in Natural Language Engineering Guest editors: - Sheila Castilho (The ADAPT Centre, School of Applied Languages and Intercultural Studies, Dublin City University) - Rebecca Knowles (National Research Council Canada) For this special issue, we invite the submission of papers focusing on the variety of novel implementations of context into neural machine translation systems as well as novel approaches to its evaluation. Recent claims that machine translation systems are reaching (near) human parity at the sentence level have been followed by subsequent analyses that indicate remaining gaps in translation quality at the document level. How best to evaluate machine translation at the document level (and what exactly constitutes document level evaluation) remains an open question. At the same time, there is work seeking to add discourse and context into neural machine translation systems. Papers that focus on topics of context in neural machine translation, machine translation evaluation, or both are welcome. For full details, see: https://sites.google.com/dcu.ie/nlecontextnmt/home Topics of interest include, but are not limited to: - Novel language processing techniques for implementing discourse in NMT systems - Document-level NMT and evaluation - Use of target and source context - Context-aware techniques for quality evaluation - Context-aware automatic and human evaluation metrics - The size and composition of the training data and its effect on context-aware systems - The effect of the quality of training data and test sets on context-aware systems - Translationese and its effect on document-level training - Lexical diversity and lexical density in discourse NMT - Discourse NMT for different domains Publication Timeline: - Article deadline submission: 1 February 2023 - Return of reviews to contributors: 1 April 2023 - Revised articles deadline submission: 1 May 2023 - Return of second reviews to contributors (if applicable): 1 July 2023 - Final Submission: 15 September 2023 - Publication: November 2023 / January 2024 Format and Submission: Typical submissions will be 12-25 pages in length. Authors should follow the "Author Instructions" section on the journal website: https://www.cambridge.org/core/journals/natural-language-engineering/inform… We highly recommend using the LaTeX template found under "Preparing your materials" at the link above. All manuscripts must be submitted online via the NLE ScholarOne website: http://mc.manuscriptcentral.com/nle. Under "Special Issue Designation", choose "The Role of Context in Neural Machine Translation Systems and its Evaluation". Queries: Any queries related to this special issue should be addressed to sheila.castilho(a)dcu.ie<mailto:sheila.castilho@dcu.ie> with NLE-ContextNMT in the subject line.

2 1

Postdoc Position (Hate Speech Detection) for up to 3 years in Milan
by mail＠dirkhovy.com 09 Jan '23

09 Jan '23

We are looking for postdocs to work with us on INDOMITA! Online hate speech has resulted in actual hate crimes. INDOMITA offers automated assistance to combat online hate speech. However, hatred is complex. The offensiveness of a phrase is determined by social customs and user demographics: “Yo, a**hole!” is acceptable among friends but not strangers. Our user-centric approach takes into account social customs and user demographics to enhance detection of nuanced forms of hate speech. We will use three strategies: - modeling a complex problem with socio-demographic context, - automating counter-argument and responding to aggressive users, and - creating evaluation methods to analyze fairness, performance, and subjectivity. Our research will bridge language gaps and shed light on the relationships between online actors and online hatred. We are seeking candidates to work on NLP, machine learning, and neural networks for representation learning, natural language understanding, and hate speech detection in various languages and modalities. Successful candidates will work closely with Prof. Dirk Hovy, Prof. Debora Nozza, and the MilaNLP lab. Your profile: • a Ph.D. in Computer Science, Computational Linguistics/NLP, Machine Learning, Data Science, or related fields. • Excellent programming skills in Python. Additional languages (C++, R, etc) a plus. • Fluency in spoken and written English. Knowledge of Italian is NOT a requirement. • Knowledge of current neural network models and implementation tools for neural networks (e.g. PyTorch, Tensorflow, Keras, etc.). • Proven track record with publications in top-tier venues in the field of NLP/Computational Linguistics/ML. Position Details: • Starting date: March 1 2023, or any time thereafter • Duration: 2 years, 1 year extension possible • Deadline: 23rd January 2023 • Salary: 42k EUR p.a. (median salary Milan: 37k EUR) Applicants from outside Italy may qualify for a researcher taxation scheme How to apply: Go to the https://jobmarket.unibocconi.eu/?type=a&urlBack=/wps/wcm/connect/Bocconi/Si… <https://jobmarket.unibocconi.eu/?type=a&urlBack=/wps/wcm/connect/Bocconi/Si…> and search for “INDOMITA”, you will then have to click on “Apply online” for proceeding with the application. Candidates should attach publications and a cover letter to their application. Online interviews will take place during February 2023. Please contact dirk.hovy(a)unibocconi.it <mailto:dirk.hovy@unibocconi.it> if you have any question.

1 0

[cfp] QPP++ 2023: Query Performance Prediction and Its Evaluation in New Tasks @ ECIR
by Guglielmo Faggioli 09 Jan '23

09 Jan '23

*Query Performance Prediction (QPP) *is currently primarily used for ad-hoc retrieval tasks. The Information Retrieval (IR) field is reaching new heights thanks to recent advances in large language models and neural networks, as well as emerging new ways of searching, such as conversational search. Such advancements are quickly spreading to adjacent research areas, including QPP, necessitating reconsidering how we perform and evaluate QPP. Important Dates Submission deadline: February 5th, 2023 Notification of acceptance: March 5th, 2023 Camera ready: March 15th, 2023 Workshop day: April 2nd, 2023 Conference days: April 3rd-6th, 2023 Call for Papers This workshop aims at stimulating discussion on three main aspects concerning the future of QPP: - *What are the emerging QPP challenges* posed by new methods and technologies, including but not limited to dense retrieval, contextualized embeddings, and conversational search? - How might these *new techniques be used to improve the quality of QPP*? - Can we claim that the current techniques for *evaluating QPP are effective in all arising scenarios*? Can we envision new evaluation protocols capable of granting generalizability in new domains? We plan to foster the discussion via *two focus groups* led by the workshop's organizers. The first focus group will identify what possibilities the QPP offers regarding new research models and IR tasks, primary considerations, issues linked to different aspects of the QPP, and the potentialities provided by new tools. The second focus group will gather the community’s concerns and solutions with respect to the QPP evaluation, especially for what concerns emerging domains. The workshop will focus on the following themes: - *Query performance prediction applied to new tasks*: Can existing QPP techniques be exploited, or which new QPP theories and models need to be devised for new tasks, such as passage-retrieval, Q&A, and conversational search? - *Query performance prediction exploiting new techniques*: How can new technologies like contextualized embeddings, large language models, and neural networks be exploited to improve QPP? - *Evaluation of query performance prediction*: How should QPP techniques be evaluated, including best practices, datasets, and resources, and, in particular, should QPP be evaluated the same for different IR tasks? It is possible to submit three main categories of manuscripts to the workshop: *Full papers*: up to 6 pages. *Short papers*: up to 3 pages. *Discussion papers*: up to 3 pages. All manuscripts are expected to address the workshop's themes as mentioned above. *Full and short papers* should contain *innovative ideas and* their experimental evaluation. *We are also interested in works containing* (methodologically sound) *preliminary results and incremental endeavours*. *Discussion papers should include work with or without preliminary results, position papers, and papers describing failures*. Such papers should foster the discussion and thus are not required to contain full-fledged results. In this sense, the experimental evaluation of the submitted discussion paper is appreciated but not required. *We are also interested in receiving contributions regarding* (methodologically sound) *failed experiments*; since the workshop will focus on new research directions, we consider it necessary also to discuss the reasons and causes of failures. Each manuscript will be peer-reviewed by at least two program committee members. *Accepted papers will be published online as a volume of the CEUR-WS proceeding series.* Submit your contribution via Easychair at the following link *https://easychair.org/conferences/?conf=qpp2023 <https://easychair.org/conferences/?conf=qpp2023>* To prepare the submission, use the one-column CEUR template. A precompiled version is available at *https://drive.google.com/file/d/1sTW16i0vlsVHVf75t0rC_30UVMPUmn3Z/view?usp=share_link <https://drive.google.com/file/d/1sTW16i0vlsVHVf75t0rC_30UVMPUmn3Z/view?usp=…>* Website *https://qpp.dei.unipd.it/ <https://qpp.dei.unipd.it/>* Organizers Guglielmo Faggioli, University of Padova, Italy, faggioli(a)dei.unipd.it Nicola Ferro, University of Padova, Italy, ferro(a)unipd.it Josiane Mothe, Université de Toulouse, IRIT, France, josiane.mothe(a)irit.fr Fiana Raiber, Yahoo Research, Israel, fiana(a)yahooinc.com

1 0

First Call For Papers: The Forth Workshop on Insights from Negative Results (co-located with EACL 2023)
by Shabnam Tafreshi 08 Jan '23

08 Jan '23

Dear colleagues, The Fourth Workshop on Insights from Negative Results in NLP Co-located with EACL, May 2 or 6, 2023 First Call for Participation TO-BE-UPDATED: <https://insights-workshop.github.io/ <https://insights-workshop.github.io/index>> Contact email: insights-workshop-organizers(a)googlegroups.com *Overview Publication of negative results is difficult in most fields, but in NLP the problem is exacerbated by the near-universal focus on improvements in benchmarks. This situation implicitly discourages hypothesis-driven research, and it turns creation and fine-tuning of NLP models into art rather than science. Furthermore, it increases the time, effort, and carbon emissions spent on developing and tuning models, as the researchers have no opportunity to learn what has already been tried and failed. This workshop invites both practical and theoretical unexpected or negative results that have important implications for future research, highlight methodological issues with existing approaches, and/or points out pervasive misunderstandings or bad practices. In particular, the most successful NLP models currently rely on different kinds of pretrained meaning representations (from word embeddings to Transformer-based models like BERT and GPT-3). To complement all the success stories, it would be insightful to see where and possibly why they fail. Any NLP tasks are welcome: sequence labeling, question answering, inference, dialogue, machine translation - you name it. A successful negative results paper would contribute one of the following: ** broadly applicable recommendations for training/fine-tuning, especially if X that didn’t work is something that many practitioners would think reasonable to try, and if the demonstration of X’s failure is accompanied by some explanation/hypothesis; ** ablation studies of components in previously proposed models, showing that their contributions are different from what was initially reported; ** datasets or probing tasks showing that previous approaches do not generalize to other domains or language phenomena; ** trivial baselines that work suspiciously well for a given task/dataset; ** cross-lingual studies showing that a technique X is only successful for a certain language or language family; ** experiments on (in)stability of the previously published results due to hardware, random initializations, preprocessing pipeline components, etc; ** theoretical arguments and/or proofs for why X should not be expected to work; ** demonstration of issues with data processing/collection/annotation pipelines, especially if they are widely used; ** demonstration of issues with evaluation metrics (e.g. accuracy, F1, or BLEU), which prevent their usage for fair comparison of methods. * Important Dates ** Submission due: February 13, 2023 ** Submission due for papers reviewed through ACL Rolling Review: March 17, 2023 ** Notification of acceptance: March 13, 2023 ** Camera-ready papers due: March 27, 2023 ** Workshop: May 2 or 6, 2023 * Submission Submission is electronic, using the Softconf START conference management system. Submission link: <https://softconf.com/eacl2023/insights2023/> The workshop will accept short papers (up to 4 pages, excluding references), as well as 1-2 page non-archival abstract submissions for papers published elsewhere (e.g. in one of the main conferences or in non-NLP venues). The goal of this event is to stimulate a meaningful community-wide discussion of the deep issues in NLP methodology, and the authors of both types of submissions will be welcome to take part in our get-togethers. The workshop will run its own review process, and papers can be submitted directly to the workshop by March 13, 2023. It is also possible to submit a paper accompanied by reviews from the ACL Rolling Review system by March 17, 2023. The submission deadline for ARR papers follows the ACL RR calendar. Both research papers and abstracts must follow the ACL two-column format. Official style sheets: <https://www.overleaf.com/read/crtcwgxzjskr> <https://github.com/acl-org/ACLPUB/tree/master/templates> Please do not modify these style files, nor should you use templates designed for other conferences. Submissions that do not conform to the required styles, including paper size, margin width, and font size restrictions, will be rejected without review. * Multiple Submission Policy The workshop cannot accept work for publication or presentation that will be (or has been) published elsewhere and that has been or will be submitted to other meetings or publications whose review periods overlap with that of Insights. Any questions regarding submissions can be sent to insights-workshop-organizers(a)googlegroups.com. If the paper has been rejected from another venue, the authors will have the option to provide the original reviews and the author's response. The new reviewers will not have access to this information, but the organizers will be able to take into account the fact that the paper has already been revised and improved. * Anonymity Period We are not enforcing any anonymity period. * Presentation All accepted papers must be presented at the workshop to appear in the proceedings. Authors of accepted papers must notify the program chairs by the camera-ready deadline if they wish to withdraw the paper. At least one author of each accepted paper must register for the workshop. Previous presentations of the work (e.g. preprints on arXiv.org) should be noted in a footnote in the camera-ready version (but not in the anonymized version of the paper). The workshop will take place on May 2 or 6 2023. The workshop will be hybrid with both in-person and virtual presentations. * Organization Committee ** Shabnam Tafreshi, University of Maryland: ARLIS ** Arjun Reddy Akula, Google ** João Sedoc, New York University ** Anna Rogers, University of Copenhagen ** Aleksandr Drozd, RIKEN ** Anna Rumshisky, University of Massachusetts Lowell / Amazon Alexa * Contact info Any questions regarding the workshop can be sent to insights-workshop-organizers(a)googlegroups.com. Please continue reading about: Authorship, Citation and Comparison, Ethics Policy, Reproducibility, Anonymity Period, and Presentation in the call for the paper page on our website: https://insights-workshop.github.io/2023/cfp/ Regards, Insights 2023 Organizers -- *Shabnam Tafreshi, PhD* *Assistant Research Scientist* *Computational Linguistics, NLP* *UMD: ARLIS @ College Park* *"All the problems of the world could be settled easily, if people only willing to think."* *-Thomas J. Watson*

1 0

Fwd: Fully funded PhD studentships in NLP, Queen Mary University of London
by Matthew Purver 06 Jan '23

06 Jan '23

A reminder of the funded PhD studentships in NLP/computational linguistics available at Queen Mary University of London - application deadline 31st January 2023 - see below for details of topics and funding. Please note that our EPSRC and Principal's fund studentships have some restrictions on eligibility, and for these we are particularly seeking applicants with *UK home fee status*. ---------- Forwarded message --------- From: Matthew Purver via Corpora <corpora(a)list.elra.info> Date: Mon, 19 Dec 2022 at 12:44 Subject: [Corpora-List] Fully funded PhD studentships in NLP, Queen Mary University of London To: corpora(a)list.elra.info <corpora(a)list.elra.info> A number of funded PhD studentships in NLP/computational linguistics are available in the Computational Linguistics Lab in the School of Electronic Engineering and Computer Science at Queen Mary University of London, UK, for September 2023 entry. Studentships are available on a range of specified topics with particular supervisors. Funding conditions, length of studentship and eligibility vary with topic - please see the links in the list below for details. - Unsupervised text anonymisation using pre-trained language models: Dr Julia Ive <https://julia-ive.github.io/>, funded via CSC (see here) <http://eecs.qmul.ac.uk/phd/phd-studentships/csc-phd-studentships-in-electro…> . - Understanding word embeddings via their algebraic-topological structures: Dr. Haim Dubossarsky <https://scholar.google.com/citations?user=2EDsENQAAAAJ>, funded via CSC (see here) <http://eecs.qmul.ac.uk/phd/phd-studentships/csc-phd-studentships-in-electro…>. - Prompt-based learning for adaptive context-dependent NLP: Prof. Matthew Purver <http://www.eecs.qmul.ac.uk/~mpurver/>, funded via CSC (see here) <http://eecs.qmul.ac.uk/phd/phd-studentships/csc-phd-studentships-in-electro…> . - Evaluating and Learning with Disagreements: Prof. Massimo Poesio <http://www.massimopoesio.org/>, funded via CSC (see here) <http://eecs.qmul.ac.uk/phd/phd-studentships/csc-phd-studentships-in-electro…>. - Next-generation NLP methods for meaning change: Dr. Haim Dubossarsky <https://scholar.google.com/citations?user=2EDsENQAAAAJ>, funded via QMUL's Principal's fund (see here) <http://eecs.qmul.ac.uk/phd/phd-studentships/principal-and-epsrc-dtp-phd-stu…> . - Meaning coordination in dialogue: Prof. Matthew Purver <http://www.eecs.qmul.ac.uk/~mpurver/>, funded via EPSRC (see here) <http://eecs.qmul.ac.uk/phd/phd-studentships/principal-and-epsrc-dtp-phd-stu…> . More details on the topics and funding conditions are available from this page: http://eecs.qmul.ac.uk/phd/phd-studentships/ If you are interested, please get in touch with the relevant supervisor directly. Final applications are due by 31st January 2023. -- Matthew Purver - http://www.eecs.qmul.ac.uk/~mpurver/ Computational Linguistics Lab - http://compling.eecs.qmul.ac.uk/ Cognitive Science Research Group - http://cogsci.eecs.qmul.ac.uk/ School of Electronic Engineering and Computer Science Queen Mary University of London, London E1 4NS, UK *My working days for QMUL are Tuesday-Thursday; responses to mail on other days may be delayed.*

1 0

2025

2024

2023

2022