- Corpora - ELRA lists

Call-for-Participation: 1st Recommending Task @ ImageCLEF 2023 (Cultural Heritage Content-based Recommendation Task)
by Bogdan Ionescu 09 Mar '23

09 Mar '23

[Apologies for multiple postings] ImageCLEFrecommending (1st edition) Registration: https://www.imageclef.org/2023/recommending Run submission: May 10, 2023 Working notes submission: June 5, 2023 CLEF 2023 conference: September 18-21, Thessaloniki, Greece *** CALL FOR PARTICIPATION *** In recent years cultural heritage organisations have made considerable efforts to digitise their collections, and this trend is expected to continue due to organisational goals and national cultural policies. Thus media archives have not only exponentially increased in size, but now hold contents in various modalities, e.g., video, image, text. Even when structured metadata is available it is still difficult to discover the contents of media archives and allow users to navigate multiperspectivity in media collections. Content-based recommendation systems can help but there is limited understanding how well these perform and how relevant they are for the end-users. Moreover, the system used so far have not addressed the new user requirements of more transparency and explainability of the algorithms used. The task targets a key infrastructure for researchers and heritage professionals: Europeana. With over 53 million records, the single search bar that served as the main access point was identified as a bottleneck by many users. Thus, the strategy has gradually shifted towards exploration of the available collections based on themes. Now users can explore over 60 curated digital exhibitions, countless galleries and blog posts. While there is a system in place to recommend individual items given a query item, the recommendations for editorials are done at the moment only manually. For instance when a new blog is created, the author would manually provide a list of related galleries, blogs or exhibitions that have been already published. *** TASK *** The task requires participants to devise recommendation methods and systems, apply them in the supplied data set gathered from Europeana and provide a series of recommendations in two scenarios: (i) given a list of items provide a list of recommended items; (ii) given an editorial (Europeana blog or gallery) provide a list of recommended editorials. *** DATA SET *** For the task a new dataset based on Europeana items and editorials will be provided to the participants. The individual items in the dataset will include a wealth of metadata based on the Europeana Data Model (EDM) schema. Editorials will be either Galleries (containing a title, optional description and list of items which make it up), or blog posts (containing a title, text in English and a number of items). It should be noted that although all data items follow EDM the quality of the metadata is not perfect, with some data fields being potentially somewhat ambiguous, or at least used sometimes in a creative way by the original data providers (especially with some overlap sometimes in what ends up in "format", "medium", "type" and "subject". *** METRICS *** Performance will be evaluated on the basis of the recommendations that are provided computing Mean Average Precision at X (Map@X) compared to the ground truth. Moreover, the systems competing in this task that can provide an explanation for the results provided will be preferred. *** IMPORTANT DATES *** - Run submission: May 10, 2023 - Working notes submission: June 5, 2023 - CLEF 2023 conference: September 18-21, Thessaloniki, Greece (https://clef2023.clef-initiative.eu/) *** OVERALL COORDINATION *** Alexandru Stan, IN2 Digital Innovations, Germany George Ioannidis, IN2 Digital Innovations, Germany Bogdan Ionescu, Politehnica University of Bucharest, Romania Hugo Manguinhas, Europeana Foundation, Netherlands *** ACKNOWLEDGEMENT *** The task is supported under the H2020 AI4Media â€œA European Excellence Centre for Media, Society and Democracyâ€ project, contract #951911 https://www.ai4media.eu/. On behalf of the Organizers, Bogdan Ionescu https://www.AIMultimediaLab.ro/

1 0

First Call For papers: 16th International Natural Language Generation Conference INLG 2023
by Simeon Schüz 09 Mar '23

09 Mar '23

*First Call For papers: 16th International Natural Language Generation Conference INLG 2023* We invite the submission of long and short papers, as well as system demonstrations, related to all aspects of Natural Language Generation (NLG), including data-to-text, concept-to-text, text-to-text and vision-to-text approaches. Accepted papers will be presented as oral talks or posters. The event is organized under the auspices of the Special Interest Group on Natural Language Generation (SIGGEN) (https://aclweb.org/aclwiki/SIGGEN) of the Association for Computational Linguistics (ACL) (https://aclweb.org/). The event will be held from 11-15 September in Prague, Czech Republic. INLG 2023 will be (jointly) colocated with SIGDial 2023. *Important dates* All deadlines are Anywhere on Earth (UTC-12) - START system regular paper submission deadline: May 22, 2023 - ARR commitment to INLG deadline via START system: June 15, 2023 - START system demo paper submission deadline: June 15, 2023 - Notification: July 11, 2023 - Camera ready: July 25, 2023 - Conference: 11-15 September 2023 *Topics* INLG 2023 solicits papers on any topic related to NLG. General topics of interest include, but are not limited to: - Affect/emotion generation - Analysis and detection of automatically generated text - Bias and fairness in NLG systems - Cognitive modelling of language production - Computational efficiency of NLG models - Content and text planning - Corpora and resources for NLG - Ethical considerations of NLG - Evaluation and error analysis of NLG systems - Explainability and Trustworthiness of NLG systems - Generalizability of NLG systems - Grounded language generation - Large Language Models for NLG - Lexicalisation - Multimedia and multimodality in generation - Natural language understanding techniques for NLG - NLG and accessibility - NLG in speech synthesis and spoken language models - NLG in dialogue - NLG for human-robot interaction - NLG for low-resourced languages - NLG for real-world applications - Paraphrasing, summarization and translation - Personalisation and variation in text - Referring expression generation - Storytelling and narrative generation - Surface realisation - System architectures *Submissions & Format* Three kinds of papers can be submitted: - Long papers are most appropriate for presenting substantial research results and must not exceed eight (8) pages of content, plus unlimited pages of ethical considerations, supplementary material statements, and references. The supplementary material statement provides detailed descriptions to support the reproduction of the results presented in the paper (see below for details). The final versions of long papers will be given one additional page of content (up to 9 pages) so that reviewers' comments can be taken into account. - Short papers are more appropriate for presenting an ongoing research effort and must not exceed four (4) pages, plus unlimited pages of ethical considerations, supplementary material statements, and references. The final versions of short papers will be given one additional page of content (up to 5 pages) so that reviewers' comments can be taken into account. - Demo papers should be no more than two (2) pages, including references, and should describe implemented systems relevant to the NLG community. It also should include a link to a short screencast of the working software. In addition, authors of demo papers must be willing to present a demo of their system during INLG 2023. Submissions should follow ACL Author Guidelines (https://www.aclweb.org/adminwiki/index.php?title=ACL_Author_Guidelines) and policies for submission, review and citation, and be anonymised for double blind reviewing. Please use ACL 2023 style files; LaTeX style files and Microsoft Word templates are available at https://2023.aclweb.org/calls/style_and_formatting/. Authors must honour the ethical code set out in the ACL Code of Ethics (https://www.aclweb.org/portal/content/acl-code-ethics). If your work raises any ethical issues, you should include an explicit discussion of those issues. This will also be taken into account in the review process. You may find the following checklist of use: https://aclrollingreview.org/responsibleNLPresearch/ Authors are strongly encouraged to ensure that their work is reproducible; see, e.g., the following reproducibility checklist (https://2021.aclweb.org/calls/reproducibility-checklist/). Papers involving any kind of experimental results (human judgments, system outputs, etc) should incorporate a data availability statement into their paper. Authors are asked to indicate whether the data is made publicly available. If the data is not made available, authors should provide a brief explanation why. (E.g. because the data contains proprietary information.) A statement guide is available on the INLG 2023 website (https://inlg2023.github.io/). To submit a long or short paper to INLG 2023, authors can either submit directly or commit a paper previously reviewed by ARR via the same paper submission site (https://softconf.com/n/inlg2023/). For direct submissions, the deadline for submitting papers is May 22, 2023, 11:59:59 AOE. If committing an ARR paper to INLG, the submission is also made through the INLG 2023 paper submission site, indicating the link of the paper on OpenReview. The deadline for committing an ARR paper to INLG is June 15, 2023, 11:59:59 AOE, and the last eligible ARR paper submission deadline for INLG 2023 is April 15, 2023. It is important to note that when committing an ARR paper to INLG, it should be submitted through the INLG 2023 paper submission site, just like a direct submission paper, with the only difference being the need to provide the OpenReview link to the paper and to provide an optional author response to reviews. Demo papers should be submitted directly through the INLG 2023 paper submission site (https://softconf.com/n/inlg2023/) by June 15, 2023, 11:59:59 AOE. All accepted papers will be published in the INLG 2023 proceedings and included in the ACL anthology. A paper accepted for presentation at INLG 2023 must not have been presented at any other meeting with publicly available proceedings. Dual submission to other conferences is permitted, provided that authors clearly indicate this in the submission form. If the paper is accepted at both venues, the authors will need to choose which venue to present at, since they can not present the same paper twice. *Awards* INLG 2023 will present several awards to recognize outstanding achievements in the field. These awards are: - Best Long Paper Award: This award will be given to the best long paper submission based on its originality, impact, and contribution to the field of NLG. - Best Short Paper Award: This award will be given to the best short paper submission based on its originality, impact, and contribution to the field of NLG. - Best Demo Paper Award: This award will recognize the best demo paper submitted to the conference. This award considers not only the paper's quality but also the demonstration given at the conference. The demonstration will play a significant role in the judging process. - Best Evaluation Award: The award is a new addition to INLG 2023. This award is designed to honour authors who have demonstrated the most comprehensive and insightful analysis in evaluating their results. This award aims to highlight papers where the authors have gone the extra mile in providing a thorough and detailed analysis of their results, offering a nuanced understanding of their findings.

1 0

ELE 2 project: survey on computing facilities for NLP/LT
by gaurish thakkar 09 Mar '23

09 Mar '23

*Apologies for cross-posting* Within the European Language Equality 2 project (https://european-language-equality.eu/) we are collecting information about various computing facilities and requirements for NLP/LT. The analysis of collected information will result in a snapshot of the current situation and relevant recommendations for High Performance Computing use in NLP/LT. If you are an NLP/LT researcher who uses HPC (e.g. GPUs, clusters, grids) in your work, we would appreciate if you could fill out this short survey: https://forms.gle/vcMF8nPmMSR9BZo27. Please, complete the survey until 2023-03-22. Here (https://european-language-equality.eu/) you can find more about the project and on the background of this survey. Thank you in advance for your valuable insights. Marko Tadić -- Marko Tadić, professor University of Zagreb Faculty of Humanities and Social Sciences Department of Linguistics Ivana Lučića 3 HR-10000 Zagreb Croatia w: http://www.ffzg.unizg.hr/oling/?page_id=88 o: https://orcid.org/0000-0001-6325-820X --

1 0

[CfP] SEMANTiCS 2023 – Workshop & Tutorial Track|| Extended Submission Deadline March 15, 2023
by Anisa Rula & Jennifer D'Souza 08 Mar '23

08 Mar '23

==== SEMANTiCS - 19th International Conference on Semantic Systems Leipzig, Germany Workshops and Tutorials September 20 - 22, 2023 https://2023-eu.semantics.cc/page/cfp_ws ==== SEMANTiCS 2023 is a major venue for research and industrial innovation and features a workshop and tutorial program addressing the diverse practical interests of its audience. This program is intended to offer a rich diversity of topics to conference attendees and local participants seeking to pick up new skills and stay up-to-date regarding the latest developments in the community. We encourage submissions of proposals on all topics in the general areas of SEMANTiCS 2023 and proposals bridging or introducing new perspectives in these areas. Workshops and tutorials may incorporate panel discussions, lightning talks, meetings, networking or hands-on sessions, hackathons and other practical formats where applicable. Rooms for business or project meetings are available upon request as well. =Important Dates for Workshops= * Proposals WS *Extended* Deadline: March 15, 2023 (11:59 pm, Hawaii time) * Notification of Acceptance: March 22, 2023 (11:59 pm, Hawaii time) =Important Dates for Tutorials (and other meetings, e.g. seminars, show-cases, etc., without call for papers)= * Proposals Tutorial Deadline: June 06, 2023 (11:59 pm, Hawaii time) * Notification of Acceptance: June 20, 2023 (11:59 pm, Hawaii time) Submission via Easychair on https://easychair.org/conferences/?conf=sem23 =Scope & Goals= Workshops and tutorials at SEMANTiCS 2023 allow your organisation or project to advance and promote your topics and gain increased visibility. The workshops and tutorials will be announced on the SEMANTiCS website and they will be seen by all participants. SEMANTiCS 2023 workshops and tutorials can be incubators for industrial and scientific communities that form and share a particular research and development agenda. They provide a forum for presenting contributions and findings to a diverse and knowledgeable community. Furthermore, the event can be used as a dissemination activity in the scope of large research projects or as a closed format for research/commercial project consortia meetings. =Setup and Requirements= SEMANTiCS 2023 workshops and tutorials may be either half or full day long. Workshops and tutorials take place on the days before and/or after the main SEMANTiCS 2023 EU conference (20th, 21st, and/or 22nd of September 2023). Details will be communicated on time. Organizers of workshops and tutorials will be granted three free tickets (only for the workshop & tutorial day) for organization purposes or keynotes. Participants of workshops and tutorials will be charged a marginal fee to cover the basic costs. Workshop and tutorials proposals must include the following information: * outline of the themes and goals of the event, including a title and a brief abstract (less than 200 words) intended for the SEMANTiCS 2023 website * a statement addressing why the event is important, why the event is timely, how it is relevant to SEMANTiCS 2023 and the field of semantic web. For the tutorials, why the presenters are qualified for a high-quality introduction of the topic * related workshops and conferences, i.e., specifying if this is a continuation of a workshop series or is a new workshop to address an emerging issue. Please provide information about past versions of this workshop and other related workshops (including URLs and submission/acceptance counts, if available). * a statement addressing the quality assurance criterion that will be used by the event organizers to select the papers for the workshops and the presenters for the tutorials (e.g., peer review or review/evaluation by event organizers). If a peer review process is chosen as a quality assurance criterion for the workshops, the organizers will be responsible for their own reviewing process. Workshop organizers will be responsible also for their own publicity (e.g., website, timelines and call for papers) and proceedings production. * structure of the event and plans for generating and stimulating discussion; how will the interaction be organized in case of a hybrid event * desired minimum and maximum number of event participants, expected number of participants, and (in case of previously held events) number of registered attendees and web site for previous editions of the event * a description of the intended audience and the expected learning outcomes * desired prerequisite knowledge of the audience * proposed duration of the event (i.e., half or full day), different sessions if applicable (final time slot will be assigned in accordance with the SEMANTiCS program) * any equipment, room capacity, or other logistic constraints * full contact information of all organizers of the event and main contact person; a brief description of each organizer's background, including relevant past experience in organizing events Proposals for workshop and tutorial proposals must be submitted via Easychair: https://easychair.org/my/conference?conf=sem23 =Review and Evaluation Criteria= Workshop and tutorial proposals will be reviewed by the SEMANTiCS 2023 Workshop Chairs, as well as by the SEMANTiCS 2023 organizing committee, according to the following criteria: * The potential to advance the state of semantic web research and practice * The quality assurance criterion proposed by the organizers to select high-quality papers for workshops and presenters for tutorials * The organizers' experience and ability to lead a successful event * Timeliness and expected interest in the event topics * The balance and synergy between all SEMANTiCS 2023 events =Topics of interest include (but are not limited to)= * Web Semantics & Linked (Open) Data * Enterprise Knowledge Graphs, Graph Data Management and Deep Semantics * Machine Learning & Deep Learning Techniques * Semantic Information Management & Knowledge Integration * Terminology, Thesaurus & Ontology Management * Data Mining and Knowledge Discovery * Reasoning, Rules and Policies * Natural Language Processing and Computational Linguistics * Social and Human aspects of Semantic Web * Data Quality Management and Assurance * Explainable Artificial Intelligence * Semantics in Data Science * Semantics of Blockchain & Distributed Ledger Technologies * Trust, Data Privacy, and Security with Semantic Technologies * Economics of Data, Data Services and Data Ecosystems * Applications of Semantic Web technologies in domains such as law, medicine, life sciences, digital humanities, mobility and smart cities, etc. We especially invite contributions that illustrate the applicability of the topics mentioned above for industrial purposes and/or illustrate the business relevance of their contribution for specific industries. Workshop proposals on emerging themes for the topics listed above are encouraged. In case you have additional questions concerning the submission process, please do not hesitate to contact us via Easychair. We are looking forward to your contribution! Jennifer D’Souza - jennifer.dsouza(a)tib.eu Anisa Rula - anisa.rula(a)unibs.it Workshop & Tutorial Chairs

1 0

CfP: 3rd Workshop DL4LD: Addressing Deep Learning, Relation Extraction, and Linguistic Data
by Radovan Garabik 08 Mar '23

08 Mar '23

Call for papers 3rd Workshop DL4LD (Deep Learning, Relation Extraction and Linguistic Data with a Case Study on BATS) as a continuation of the series of DL4LD (Deep Learning and Neural Approaches for Linguistic Linked Data) workshops University of Vienna, Vienna, Austria 13 September 2023 Website: http://dl4ld2023.mruni.eu/ The fourth biennial conference on Language, Data and Knowledge (LDK 2023) ( http://2023.ldk-conf.org/ ) and Cost Action CA18209 NexusLinguarum (https://nexuslinguarum.eu) are glad to announce the 3rd workshop DL4LD (Deep Learning, Relation Extraction and Linguistic Data with a Case Study on BATS): Addressing Deep Learning, Relation Extraction, and Linguistic Data with a Case Study on The Bigger Analogy Test Set (BATS). The workshop will be held in a hybrid mode, so speakers and attendees can choose to participate onsite or online. Conference aims and topics The workshop welcomes contributions from scholars and researchers working in computational linguistics, data science, linguistics, computer science, etc. This workshop aims at bringing together relation extraction, deep learning, and neural approaches with linguistic linked data. We invite research papers, application descriptions, system demonstrations, and position papers that discuss the interconnection of both areas. The workshop is going to include a twofold session with the first part focusing on the workshop presentations and the second part poster presentations on the multilingual linguistic data preparation for NLP experiments focusing on the case study of BATS. We suggest the researchers working on related languages join teams and present rich comparative case studies. Panel discussion includes “unorthodox” new ideas, overviews of the challenges and opportunities of multilingual data preparation for the BATS experiment. The workshop presents an excellent opportunity for the exchange of ideas, insights, and the latest research. The workshop topics are (but not limited to) the following: Topics: • Deep Learning for Linguistic Linked (Open) Data, modelling, resources & interlinking • LLOD and Deep Learning for Digital Humanities • Enhancement of language models with structured linguistic data • Use cases combining language models and structured linguistic data • Deep Learning and LLOD in NLP • Deep learning and relation extraction • Deep learning and knowledge graphs • Multilingual data preparation for the BATS experiment Deep learning and neural network approaches are indispensable in modern Natural Language Processing and generally in all kinds of linguistic data analysis approaches. Artificial intelligence integrating knowledge is one of the core topics in the current research which focuses on providing human thinking for AI to solve complex tasks. One of the important techniques for supporting this research is knowledge acquisition or so-called relation extraction. Relation extraction and deep learning can serve the understanding of the specificities of linguistic data, to be better exploited and combined with linked data mechanisms. Knowledge is a way of understanding the world, aiming to provide a human-level cognition and intelligence for the next-generation artificial intelligence. One way of knowledge representation is semantic relations between entities. Relation Extraction ensures an effective way to automatically acquire important knowledge of semantic relations. It is a sub-task of information extraction and plays an essential role in Natural Language Processing. Its purpose is to identify semantic relations between entities from natural language text. Concerning the current research, there is a field of studies for relation extraction which have described the techniques based on Deep Neural Networks used as a prevailing technique in the research. The workshop intends to be an event of discussion for researchers interested in addressing the peculiarities of the interrelated research areas mentioned before and in advancing the state of the art in deep learning, relation extraction, and linguistic data science. Program: The Scientific Program will include an invited talk and research presentations, followed by the panel discussion. Invited Speaker: Michael Cochez, Vrije Universiteit Amsterdam Submissions and dates Submissions can be in the form of: • short papers: 4–6 pages; • long papers: 9–12 pages. All submission lengths are given including references. Accepted submissions will be published by ACL in an open-access conference proceedings volume, free of charge for authors. The ACL templates should therefore be used for all conference submissions (https://github.com/acl-org/acl-style-files/). As the reviewing process is single-blind, submissions should not be anonymised. The workshop will be hybrid. At least one author of each accepted paper is required to register for the workshop and present their work (either remotely or on-site). There will be no registration fee for participation. Submissions must be submitted via EasyChair: https://easychair.org/conferences/?conf=dl4ld2023/ Important dates: Time Zone: Anywhere on Earth Papers due: May, 19, 2023 Papers acceptance notifications: June, 16, 2023 Camera-ready papers due: June, 30, 2023 Registration for participation without submissions deadline: August 30th, 2023 Program committee Andrius Utka, Vytautas Magnus University, Lithuania Chaya Liebeskind, Jerusalem College of Technology, Israel Ciprian-Octavian Truica, Uppsala University, Sweden Cosimo Palma, University of Naples “L’Orientale” – University of Pisa, Italy Dagmar Gromann, University of Vienna, Austria Enriketa Sogutlu, University College Bedër, Albania Giedre Valunaite Oleskeviciene, Mykolas Romeris University, Lithuania Hugo Gonçalo Oliveira, University of Coimbra, Portugal Jorge Gracia del Río University of Zaragoza, Spain Mariana Damova, Mozaika, Bulgaria Michael Cochez, Vrije Universiteit Amsterdam, Netherlands Purificação Silvano, University of Porto, Portugal Radovan Garabík, Ľ. Štúr Institute of Linguistics, Slovak Academy of Sciences, Slovakia Sigita Rackevičienė, Mykolas Romeris University, Lithuania Organizing committee Giedrė Valūnaitė Oleškevičienė, Mykolas Romeris University, Lithuania Radovan Garabík, Ľ. Štúr Institute of Linguistics, Slovak Academy of Sciences, Slovakia Chaya Liebeskind, Jerusalem College of Technology, Israel Cosimo Palma, University of Naples “L’Orientale” – University of Pisa, Italy Enriketa Sogutlu, University College Bedër, Albania Purificação Silvano, University of Porto, Portugal Sigita Rackevičienė, Mykolas Romeris University, Lithuania Contact: gvalunaite(a)mruni.eu

1 0

CFP Dataset Released - ClinAIS Shared Task at IberLEF2023
by iker.delaiglesia＠ehu.eus 08 Mar '23

08 Mar '23

IberLEF 2023 Task ClinAIS: Automatic Identification of Sections in Clinical Documents Website: https://ixa2.si.ehu.eus/clinais/ ClinAIS: will be organized as part of IberLEF 2023, at the SEPLN 2023 Conference (Jaen, September 2023). TRAIN AND DEV DATA AVAILABLE NOW ! The ClinAIS task presented at IberLEF 2023 aims to tackle the problem of automatic identification of sections in unstructured Spanish clinical documents. The task is focused on identifying 7 predefined medical sections: Present Illness, Derived from/to, Past Medical History, Family history, Exploration, Treatment and Evolution in ECNs, mainly progress notes. The successful resolution of this task will enable the improvement of higher level applications that can extract valuable, actionable information from clinical documents, such as medical entity recognition, patient cohort retrieval, and temporal relation extraction. This will ultimately improve patient care and clinical decision-making. IMPORTANT DATES ✔ March 2023 Release of Train + Dev Sets and Evaluation Library - April 2023 Release of Test and Background Set - May 2023 Submission of Results. - May 2023 System Paper Submission Deadline. - June 2023 Notification to Authors. - June 2023 Camera Ready Submission Deadline. - September 2023 Publication of Proceedings. - September 2023 IberLEF within SEPLN 2023. ORGANIZERS HiTZ Center Iker de la Iglesia, Research Scientist Aitziber Atutxa, Associate Professor at UPV/EHU Koldo Gojenola, Associate Professor at UPV/EHU Esther Miranda, Technical Staff IOMED María Vivó, NLP Data Scientist Paula Chocrón, NLP Engineer & Researcher Gabriel de Maeztu, Co-founder & CTO at IOMED Contact: ixa.iomed-clinais(a)ehu.es Registration (please register in both the official website and CodaLab): https://ixa2.si.ehu.eus/clinais/registration https://codalab.lisn.upsaclay.fr/competitions/10751

1 0

CD-MAKE 2023 special session on “Multi-Perspectivist Data and Learning”
by Valerio Basile 08 Mar '23

08 Mar '23

Dear colleagues, We are happy to announce the call for papers for our one-day special session on “Multi-Perspectivist Data and Learning 2023” at the upcoming CD MAKE 2023 conference: https://cd-make.net/special-sessions/multi-perspectivist-data-and-learning/ *************************************************** Description, scope and aims Many Artificial Intelligence applications are based on supervised machine learning (ML), which ultimately grounds on manually annotated data. The annotation process (i.e., ground-truthing) is often performed in terms of a majority vote and this has been proved to be often problematic, as highlighted by recent studies on the evaluation of ML models. Recently, a different paradigm for ground-truthing has started to emerge, called data perspectivism, which moves away from traditional majority aggregated datasets, towards the adoption of methods that integrate different opinions and perspectives within the knowledge representation, training, and evaluation steps of ML processes, by adopting a non-aggregation policy. This alternative paradigm obviously implies a radical change in how we develop and evaluate ML systems: such ML systems have to take into account multiple, uncertain, and potentially mutually conflicting views. This obviously brings both opportunities and difficulties: novel models or training techniques may need to be designed, and the validation phase may become more complex. Nonetheless, initial works have shown that data perspectivism can lead to better performances, and could also have important implications in terms of human-in-the-loop and interpretable AI, as well as in regard to the ethical issues or concerns related to the use of AI systems. The scope of this special session is to attract contributions related to the management of subjective, crowd-sourced, multi-perspective, or otherwise non-aggregated data in ground-truthing, machine learning, and more generally artificial intelligence systems. Invited contributions: full research papers and research in progress papers. *************************************************** Topics of interest: - Subjective, uncertain, or conflicting information in annotation and crowdsourcing processes; - Limits and problems with standard data annotation and aggregation processes; - Theoretical studies on the problem of learning from multi-rater and non-aggregated data; - Participation mechanisms/incentives/gamification for rater engagement and crowdsourcing; - Ethical and legal concerns related to annotation and aggregation processes in ground-truthing; - Creation and documentation of multi-rater and non-aggregated datasets and benchmarks; - Development of ML algorithms for multi-rater and non-aggregated data; - Techniques for the evaluation of ML systems based on multi-rater and non-aggregated data; - Applications of data perspectivism and non-aggregated data to eXplainable AI, human-in-the-loop AI and algorithmic fairness; - Experimental and application studies of ML/AI systems on multi-rater and non-aggregated data, in possibly different application domains (e.g. NLP, medicine, legal studies, etc.) *************************************************** Important dates: Submission Deadline March 27, 2023 (AoE) Author Notification June 01, 2023 Proceedings Version June 22, 2023 (AoE) Conference August 29 – September 01, 2023 *************************************************** Special Session Chairs: Federico Cabitza (University of Milano-Bicocca, Italy) Andrea Campagner (University of Milano-Bicocca, Italy) Valerio Basile (University of Turin, Italy) Program Committee (provisional): Nahuel Costa Cortez, University of Oviedo Elisa Leonardelli, Fondazione Bruno Kessler (FBK) Julian Lienen, Paderborn University Gavin Abercrombie, Heriot-Watt University Simona Frenda, University of Turin Marília Barandas, Fraunhofer Portugal AICOS Duarte Folgado, Fraunhofer Portugal AICOS Barbara Plank, Ludwig Maximilian University of Munich Tommaso Caselli, Rijksuniversiteit Groningen *************************************************** Related readings [1] Cabitza, F., Campagner, A., Basile, V. (2023) Toward a Perspectivist Turn in Ground Truthing for Predictive Computing Proceedings of the AAAI Conference on Artificial Intelligence (extended preprint at: https://arxiv.org/pdf/2109.04270.pdf) [2] V. Basile (2020) It’s the End of the Gold Standard as we Know it. On the Impact of Pre-aggregation on the Evaluation of Highly Subjective Tasks Proceedings of the AIxIA 2020 Discussion Papers Workshop [3] F. Cabitza, A. Campagner, L. M. Sconfienza (2020) As if sand were stone. New concepts and metrics to probe the ground on which to build trustable AI BMC Medical Informatics and Decision Making [4] Plank, B. (2022). The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation. arXiv preprint arXiv:2211.02570.

1 1

Ph.D. Studentship Essex University, UK
by Ravi Shekhar 07 Mar '23

07 Mar '23

Dear All, I am soliciting expressions of interest for a fully funded Ph.D. Studentship at the School of Computer Science and Electronic Engineering, Essex University, UK, starting in October 2023. The scholarship will cover three years of home/international tuition fees and a living allowance. You should have a master's degree with a strong background in Natural Language Processing, Machine Learning, and/or Linguistics. You will have the opportunity to define your research agenda in the following broad research themes: - Multi-modal Conversational Agent - Low-resource NLP - Combining social media analysis with NLP Please send me (r.shekhar(a)essex.ac.uk) your updated CV and a brief explanation of your research interest with the subject line “Ph.D. Studentship(2023): Your Name.” -- Ravi Shekhar

1 0

Call for Papers: IWCS workshop on Semantics in Organisational Communication
by Matthew Purver 07 Mar '23

07 Mar '23

CFP: SemInOrgCom: Semantics in Organisational Communication https://sodestream.github.io/seminorgcom/ June 20th, Nancy, France Co-located with IWCS 2023 Important dates: Regular and non-archival submissions: * April 14th Submission deadline * May 12th Notification of acceptance * June 9th Camera ready deadline for regular papers Hackathon: * March 8th – May 31st Participants working on Hackathon * March 31st First meeting with Hackathon participants * May 2nd Second meeting with Hackathon participants * June 7th Submission deadline for system description papers * June 9th Camera ready deadline for hackathon system description papers Workshop: * 20th Jun Workshop date Keynote speakers: Dr. Colin Perkins (University of Glasgow; chair, Internet Research Task Force) Prof. Magda Osman (University of Cambridge) Workshop description: Interaction and communication are at the heart of every organisation, from small to large, and take many forms: email, group messaging applications, face-to-face and online meetings of various sizes, and others. Insights into how people express complex issues, discuss their own and others’ intentions and make decisions could help make these processes more efficient and/or transparent and lead to a range of assistive tools. However, the group interaction involved is often at a scale between the small scales usually assumed in computational semantics or dialogue modelling, and the very large scales usually studied in social networks. The organisational nature also brings important factors that affect language and the meaning expressed or understood – explicit or implicit hierarchy, shared or disputed goals, and social groupings with competitive or collaborative agendas – well known in other disciplines but not often taken into account in computational semantics. The computational linguistics community has looked at various relevant phenomena and tasks (e.g., meeting summarization, intention detection, intention detection, argument mining, agreement/disagreement detection, persuasiveness detection), and some relevant datasets have been produced (e.g., the Enron email dataset). However, there are still relatively few attempts and few resources or approaches to semantics in organisational communication in general. This workshop aims to fill this gap to model, analyse and understand overall organisational communication, and encourage collaboration between researchers from diverse backgrounds, including computational linguistics, organisational psychology, and computational social science. Main topics: We welcome work broadly in the area of natural language processing, computational linguistics, computational social science, sociolinguistics, organisational psychology, and related fields with the aim of better understanding organisational communication. Cross-disciplinary collaborations between computer scientists and other social scientists in order to reach richer insights are especially welcome. We also encourage contributions that address multilingual settings as well as low-resource languages. The workshop topics include but are not limited to: * Summarization of meetings and other organisational communication * Models of argument, (dis)agreement and decision-making * Analysis of influence, persuasiveness and power relations * Effects of organisational culture and hierarchy * Communication across different modalities and timescales * Differences between organisational communication and other forms of communication * Datasets and annotation schemas for organisational communication * Social network analysis in organisations as applied to communication * Diachronic analysis of organisational communication * Application and adaptation of NLP models to organisational communication. Format: Regular submissions (long and short) Authors are invited to submit full papers of up to 8 pages of content and short papers of up to 4 pages of content, with unlimited pages for references. Accepted papers will be given an additional page of content to address reviewer comments and will be published in the ACL Anthology. Previously published papers cannot be accepted. Dual submissions are allowed; papers that are currently undergoing review at other venues are welcome but must declare this on submission. Non-archival submissions We welcome two types of non-archival submissions. First, you can submit an extended abstract of work not published elsewhere. These can include position papers, or early-stage work that would benefit from peer feedback. Second, work previously accepted/published elsewhere, along with details about the venue or journal where it is accepted, and a link to the archived version, if available. In both cases there are no page limits, or style/anonymity requirements, and the submissions will be reviewed only for the fit to the workshop theme. Papers accepted as non-archival will be given an opportunity to present the work at the workshop but will not be published in the ACL Anthology (they will be available on the workshop website). Hackathon submissions An active, experimentation-based track where hackathon-type online activities precede the workshop, and teams/individuals present their work in the workshop. The hackathon organisers will provide data, task suggestions, and periodic feedback. Though, participants are free to work on any relevant task or dataset during their hackathon project. Hackathon activities are by design online, while the rest of the workshop will be in person. Hackathon participants are invited (but not required) to submit a system description paper (up to 4 pages + unlimited pages for references); authors will be able to choose whether these are published in the ACL anthology. Journal special issue After the workshop, we will explore the possibility of inviting selected authors to submit a paper to a special issue of the Dialogue & Discourse journal. The journal submissions would undergo further review, and the paper should be substantially different from the original work. Submission instructions: Similar to IWCS, regular submissions should be fully anonymous to ensure double-blind reviewing. All submissions should follow the IWCS conference template (see https://iwcs2023.loria.fr/call-for-papers/) Submission link: https://softconf.com/iwcs2023/seminorgcom/ Program committee: Ignacio Castro, Queen Mary University of London Goran Glavaš, University of Würzburg Patrick Healey, Queen Mary University of London Mladen Karan, Queen Mary University of London Stephen McQuistin, University of Glasgow Paul Piwek, Open University Matthew Purver, Queen Mary University of London and Jožef Stefan Institute Ravi Shekhar, University of Essex Gareth Tyson, Hong Kong University of Science of Science and Technology Andreas Vlachos, University of Cambridge Ivan Vulić, University of Cambridge (more TBA) -- Matthew Purver - http://www.eecs.qmul.ac.uk/~mpurver/ Computational Linguistics Lab - http://compling.eecs.qmul.ac.uk/ Cognitive Science Research Group - http://cogsci.eecs.qmul.ac.uk/ School of Electronic Engineering and Computer Science Queen Mary University of London, London E1 4NS, UK *My working days for QMUL are Monday-Wednesday; responses to mail on other days may be delayed.*

1 0

Jobs at University of Leeds, UK
by Eric Atwell 07 Mar '23

07 Mar '23

University of Leeds hopes to recruit 130+ new staff, including: Lecturers in Computer Science (Software Engineering)<https://jobs.leeds.ac.uk/vacancy.aspx?ref=EPSCP1123> deadline 19/03 Lecturers in Computer Science (System Architecture)<https://jobs.leeds.ac.uk/vacancy.aspx?ref=EPSCP1124> 19/03 Lecturers in Computer Science (Theoretical Computer Science)<https://jobs.leeds.ac.uk/vacancy.aspx?ref=EPSCP1125> 19/03 Lecturer in Electronic and Electrical Engineering<https://jobs.leeds.ac.uk/vacancy.aspx?ref=EPSEE1092> 27/03 Software Development Scientist<https://jobs.leeds.ac.uk/vacancy.aspx?ref=ENVEE1637> 27/03 Research Engineer in Internet-of-Things<https://jobs.leeds.ac.uk/vacancy.aspx?ref=EPSEE1093> 5/04 Research Software Engineer<https://jobs.leeds.ac.uk/vacancy.aspx?ref=EPSCP1122> 5/04

1 0

2025

2024

2023

2022

Corpora