SIGUL March 2025

sigul@list.elra.info

4 participants
7 discussions

Call for Special Issue Proposals - Journal Natural Language Processing
by Ranasinghe, Tharindu 28 Mar '25

28 Mar '25

Journal Natural Language Processing (formerly Journal of Natural Language Engineering) *** Call for Special Issue Proposals *** In recent years the area of Natural Language Processing (NLP) has enjoyed unprecedented developments since the emergence of Deep Learning and, lately, Large Language Models. At the same time, NLP is following the trend of many other areas in becoming highly specialised, with a number of application-orientated and narrow-domain topics emerging or growing in importance. These developments, often coinciding with a lack of related literature, necessitate and warrant the publication of specialised volumes focusing on a specific topic of interest to the NLP research community. The Journal Natural Language Processing (formerly Journal of Natural Language Engineering), which features six 160-page issues per year and has had its impact factor increase yearly, invites proposals for special issues on a competitive basis covering any topics in applied NLP which have emerged as important recent developments and have attracted the attention of a number of researchers. The Journal Calls for Proposals for special issues have resulted in high-quality outputs and this year we look forward to another successful competition. Proposals on topics covering a variety of methods, tasks, resources and applications from Natural Language Processing, Computational Linguistics, Speech and Language Processing, Text Analytics and related areas are eligible. Special issues on timely NLP topics such as latest language models including Large Language Models/Generative AI, are welcome. Special issue proposals may be based on a successful workshop or a body of work associated with a particular group or section of the community. In the case of papers previously submitted to workshops, the Guest Editors will not be able to re-use previous workshop reviews. In addition, the call for papers of the accepted proposals must be open to all interested parties and all authors will be given equal treatment; in the case of proposals based on previous workshops, submissions cannot be limited to workshop participants only. Prospective proposers are also encouraged to consult the successful Journal columns "Industry Watch" and "Emerging Trends" for additional inspiration. Interested parties have the option of preliminary feedback by emailing expressions of interest accompanied by a brief description of the intended special issue to the Executive Editor (Ruslan.Mitkov(a)ua.es). He will give a brief indication of whether the topic is appropriate to the Journal. In the case of initial positive feedback, the prospective Guest Editors will be asked to submit a proposal for a special issue that will be reviewed by the Editors of the Journal and by other members of the Journal Editorial Board. The proposal for a special issue should include a brief outline of the field and rationale as to why it is important to launch a special issue on the particular topic of interest at the current time. It should include a relevant literature survey (related previous special issues, volumes, workshop and conference proceedings) and should explain the added value of the proposed special issue against the background of other relevant or competing publications and volumes (if applicable). It is desirable that evidence for the estimate of expected submissions to the special issue be provided and justified. The proposals should also include a tentative Guest Editorial Board. It is desirable that at least one (preferably two) of the members of the Guest Editorial Board is on the Editorial Board of the Journal Natural Language Processing. The proposal should also include a tentative time-scale for the production of the special issue (the time-scale committed to in the proposal should be adhered to, if the proposal is accepted), and information about the prospective Guest Editors such as relevant experience, publications etc. Time-scale - Deadline for submission of special issue proposals: 28 April 2025 (proposals to be emailed to Ruslan.Mitkov(a)ua.es with a copy to NLP(a)cambridge.org) - Notification of acceptance/rejection: 19 May 2025 - Calls for papers related to the successful proposals (at least 2 calls are recommended): 7 June 2025 first call July-September 2025 second (and third call, if applicable) Once the special issue is approved and launched, Guest Editors are expected to adhere to the same reviewing and acceptance standards as regular issues of the Journal. In particular, each submission needs to be reviewed by three members of the Guest Editorial Board or other experts in the field. To ensure geographical diversity and balance, and to avoid over-reliance on the same reviewers, each submission must not be reviewed by three experts from the same country, and no single reviewer should evaluate more than two submissions. If the Executive Editor is not satisfied with the review process for a special issue paper, he may either reject the paper or send it for additional review. As a last resort, the Executive Editor has the discretion to reject the entire special issue if the reviewing practices are found to be flawed. All special issues are required to include a survey of the field (at least 15 pages) as its first article, which can be written either by the Guest Editors or experts in the field commissioned by the Guest Editors. This is in addition to a 1-2 page preface by the Guest Editors. Best Regards Dr Tharindu Ranasinghe | Lecturer in Security and Protection Science School of Computing and Communications | Lancaster University Contact me on Teams<https://teams.microsoft.com/l/chat/0/0?users=t.ranasinghe@lancaster.ac.uk> www.lancaster.ac.uk<https://www.lancaster.ac.uk/>

1 0

[CfP] Third LLM4Eval@SIGIR 2025
by Guglielmo Faggioli 21 Mar '25

21 Mar '25

The Third Workshop on LLM4Eval progresses the discussion from the previous series. These earlier events investigated the potential and challenges of using LLMs for search relevance evaluation, automated judgments, and retrieval-augmented generation (RAG) assessment. As modern IR systems integrate search, recommendations, conversational interfaces, and personalization, new evaluation challenges arise beyond basic relevance assessment. These applications create personalized rankings, explanations, and adapt to user preferences over time, requiring new evaluation methods. Overview Recent advancements in Large Language Models (LLMs) have significantly impacted evaluation methodologies in Information Retrieval (IR), reshaping the way relevance, quality, and user satisfaction are assessed. Initially demonstrating the potential for query-document relevance judgments, LLMs are now being applied to more complex tasks, including relevance label generation, assessment of retrieval-augmented generation systems, and evaluation of the quality of text-generation systems. As IR systems evolve toward more sophisticated and personalized user experiences, integrating search, recommendations, and conversational interfaces, new evaluation methodologies become necessary. Building upon the success of our previous workshops, this third iteration of the LLM4Eval workshop at SIGIR 2025 seeks submissions exploring new opportunities, limitations, and hybrid approaches involving LLM-based evaluations. Important Dates - Paper submission deadline: April 23, 2025 (AoE) - Notification of acceptance: May 21, 2025 (AoE) - Workshop date: July 17, 2025 Topics of interest We invite submissions on topics including, but not limited to: - LLMs for query-document relevance assessment - Evaluating conversational IR and recommendation systems with LLMs - Hybrid evaluation frameworks combining LLM and human annotations - Identifying failure modes and limitations of LLM annotations - Prompt engineering strategies for improving LLM annotation quality - Standardizing protocols for reliable LLM-based evaluations - Bias, fairness, and ethical considerations in LLM evaluations - LLM annotation robustness, reliability, and reproducibility - User-centric evaluations, personalization, and subjective assessments with LLMs - Case studies and lessons from industry applications of LLM-based evaluations Submission guidelines - Papers must follow SIGIR format and should not exceed 9 pages, excluding references. - We accept full papers (published or unpublished), position papers, and demo papers. - All papers will be peer-reviewed (double-blind) by the program committee and judged by their relevance to the workshop themes and potential to generate discussion. - Previously published studies can be submitted in their original format and will be reviewed solely for their relevance to this workshop. - All submissions must be in English (PDF format). - Submission through EasyChair: https://easychair.org/conferences/?conf=llm4evalsigir25. Publication options Authors can choose between archival and non-archival options for their submissions: - Archival: Papers will be included in the workshop proceedings. - Non-archival: Papers may be uploaded to arXiv.org, allowing submission elsewhere as they will be considered non-archival. The workshop’s website will maintain a link to the arXiv versions of the papers.

1 0

RANLP 2025: Third Call for Papers and Extended Submission Deadline
by Ranasinghe, Tharindu 17 Mar '25

17 Mar '25

RANLP 2025 RECENT ADVANCES IN NATURAL LANGUAGE PROCESSING Hotel “Cherno More” Varna, Bulgaria https://ranlp.org/ranlp2025/ Summer School on Deep Learning and LLMs for NLP: 3-5 September 2025 (Wednesday-Friday) Tutorials: 6-7 September 2025 (Saturday-Sunday) Main Conference: 8-10 September 2025 (Monday-Wednesday) Workshops and shared tasks: 11-13 September 2025 (Thursday-Saturday) We are pleased to announce that the 15th biennial RANLP conference will take place in September 2025 at the Black Sea city of Varna. In addition to the conference programme of competitively peer-reviewed papers reporting on the recent advances of a wide range of Natural Language Processing (NLP) topics, the conference features keynote talks by leading experts in NLP. Poster and demo sessions will be held at the conference exhibition area. The conference will be preceded by three days of summer school on Deep Learning and LLMs for NLP (3-5 September 2025) and two days of tutorials (6-7 September 2025). Post-conference specialised workshops as well as shared tasks covering timely NLP topics will be held on 11-13 September 2025. A Student Research Workshop will run in parallel to the main conference. The Student Research Workshops (now the 9th edition) have become active discussion fora for young researchers. As from RANLP 2009, the papers accepted at RANLP and the associated workshops are included in the ACL Anthology. The RANLP proceedings are indexed by SCOPUS and DBLP. The SCOPUS SJR of RANLP proceedings is 0,299 (2023). After 2017, all accepted papers have DOI numbers. CHAIR OF THE PROGRAMME COMMITTEE Ruslan Mitkov (University of Lancaster, UK and University of Alicante, Spain) CHAIR OF THE ORGANISING COMMITTEE Galia Angelova (Bulgarian Academy of Sciences, Bulgaria) The Programme Committee members are distinguished NLP experts from all over the world. The list of PC members will be announced on the conference website in due course. INVITED SPEAKERS The list of keynote speakers at RANLP 2025 and tutorial lecturers as well as summer school lecturers and teaching assistants includes (more names will be announced in the coming weeks): KEYNOTE SPEAKERS: * Eneko Agirre (University of the Basque Country, Spain) * Roberto Navigli (Sapienza University of Rome, Italy) * Anna Rogers (IT University of Copenhagen, Denmark) TUTORIAL LECTURERS: * Burcu Can (University of Sterling, UK) * Anna Rogers and Max Müller-Eberstein (IT University of Copenhagen, Denmark) SUMMER SCHOOL LECTURERS and TEACHING ASSISTANTS (in alphabetical order): * Maram Alharbi (University of Lancaster, UK) * Isuri Nanomi Arachchige (University of Lancaster, UK) * Burcu Can (University of Sterling, UK) * Salmane Chafik (Mohammed VI Polytechnic University, Morocco) * Ernesto Luis Estevanell (University of Alicante, Spain) * Hansi Hettiarachchi (University of Lancaster, UK) * Andrei Mikheev (Daxtra Technologies, UK) * Damith Dola Mullage (University of Lancaster, UK) * Max Müller-Eberstein (IT University of Copenhagen, Denmark) * Henry Oldroyd (University of Lancaster, UK) * Tharindu Ranasinghe (University of Lancaster, UK) WORKSHOPS and SHARED TASKS: The RANLP 2025 workshops and shared tasks will be held on 11-13 September 2025. The first workshops have already been selected (see below) and further proposals are expected by 31 March 2025. * The first Interdisciplinary Workshop on Observations of Misunderstood, Misguided and Malicious Use of Language Models (OMMM 2025), organised by Piotr Przybyła, Matthew Shardlow, Clara Colombatto and Nanna Inie * The first Workshop on Ethical Concerns in Training, Evaluating and Deploying Large Language Models (EthicalLLMs 2025), organised by Damith Premasiri, Tharindu Ranasinghe and Hansi Hettiarachchi. * Natural Language Processing and Language Models for Digital Humanities organised by Isuri Nanomi Arachchige, Francesca Frontini, Ruslan Mitkov and Paul Rayson * From rules to language models: comparative evaluation of NLP methods organised by Alicia Picazo-Izquierdo, Ernesto Luis Estevanell-Valladares, Ruslan Mitkov and Raúl García Cerdá * Advancing NLP for Low-Resource Languages organised by Ernesto Luis Estevanell-Valladares, Alicia Picazo-Izquierdo and Tharindu Ranasinghe The following SHARED TASKS have been accepted and Call for Participation has been distributed: * PolyHope-M: Bridging Hope Speech Detection Across Multiple Languages, organised by Fazlourrahman Balouchzahi, Sabur Butt, Maaz Amjad, Luis Jose Gonzalez-Gomez, Abdul Gafar Manuel Meque, Helena Gomez-Adorno, Bharathi Raja Chakravarthi, Grigori Sidorov, Thomas Mandl, Ruba Priyadharshini and Saranya Rajiakodi Task website - https://www.codabench.org/competitions/5635/ * Multilingual Coreference Resolution, organised by Vijay Sundar Ram, Pattabhi RK Rao and Sobha Lalitha Devi Task website - https://www.codabench.org/competitions/5759/ * Sentiment Analysis on Arabic Dialects in the Hospitality Domain: A Multi-Dialect Benchmark, organised by Maram I. Alharbi, Salmane Chafik, Ruslan Mitkov and Saad Ezzini Task website - https://ahasis-42267.web.app/ * Multi-Domain Detection of AI-Generated Text (M-DAIGT), organised by Salima Lamsiyah, Saad Ezzini, Abdelkader El Mahdaouy, Hamza Alami, Abdessamad Benlahbib, Samir El Amrany, Salmane Chafik and Hicham Hammouchi Task website - https://ezzini.github.io/M-DAIGT/ * Identification of the severity of the depression in forum posts, organised by Isuri Anuradha, Hasintha Hewawasam, Deshan Koshala Sumanathilaka, Ruslan Mitkov, Paul Rayson and Saad Ezzini Task website - https://www.codabench.org/competitions/5894/ SUBMISSION OF PAPERS, POSTERS, DEMOS The submissions will be maintained by the conference management software START. For further instructions, please follow the submission information at the conference website at https://ranlp.org/ranlp2025/. The reviewing process will be anonymous. Double submission is acceptable, but authors will be asked to declare it at the time of submission. Submissions will be reviewed by at least three members of the Programme Committee. Authors of accepted papers will receive guidelines regarding how to produce camera-ready versions of their papers for inclusion in the proceedings. All RANLP papers have DOI numbers assigned. The full conference proceedings will be uploaded on the ACL Anthology. RANLP publishes Regular papers 8 pages (with 30 min oral presentation), Short papers 6 pages (with 20 min oral presentation), and Poster/Demo papers 4 pages (with presentation in a poster or demo session). Additional pages are allowed for references only. RANLP-2025 aims to provide early notification of acceptance to authors and presenters who need visa to enter Bulgaria. We invite early submissions of authors’ names and paper abstracts, in order to plan quick reviewing. Access to the conference management software will be available as from 1 April 2025. IMPORTANT DATES Deadline for submission of workshop proposals: 15 March 2025 31 March 2025 Workshop selection: 22 March 2025 2 April 2025 Conference abstracts submission: 11 May 2025 (strongly recommended, to facilitate review planning) Conference papers submission: 25 May 2025 Conference papers acceptance notification: 4 July 2025 Camera-ready versions of the conference papers: 31 July 2025 Workshop paper submission deadline (suggested): 6 July 2025 Workshop paper acceptance notification (suggested): 31 July 2025 Workshop paper camera-ready versions (suggested): 30 August 2025 Workshop camera-ready proceedings ready (suggested): 8 September 2025 RANLP Summer School on Deep Learning in NLP: 3-5 September 2025 RANLP tutorials: 6-7 September 2025 (Saturday-Sunday) RANLP conference: 8-10 September 2025 (Monday-Wednesday) RANLP workshops and Shared Tasks presentations: 11-13 September 2025 (Thursday-Saturday) VENUE RANLP 2025 will be held at the conference facilities of Hotel “Cherno More” (http://www.chernomorebg.com<http://www.chernomorebg.com/> ) in Varna, the largest city on the Bulgarian Black Sea Coast. The event venue is centrally located at the entrance of the Sea Garden and offers excellent conference facilities. The city is a major tourist destination with flights to/from the Varna International Airport. It is also known for its Archaeological Museum, which features the oldest gold treasure in the world (https://en.wikipedia.org/wiki/Varna_Necropolis). The conference organisers plan to arrange a visit to Provadia-Solnitsata, the oldest salt-production and urban centre in Europe (5600 - 4350 BC, https://provadia-solnitsata.com/en/ ) which is located 50 km from Varna. THE TEAM BEHIND RANLP-25 Galia Angelova, Bulgarian Academy of Sciences, Bulgaria (Chair Organising Committee) Ruslan Mitkov, University of Lancaster, UK and University of Alicante, Spain (Chair Programme Committee) Nikolai Nikolov, Bulgarian Association for Computational Linguistics, Bulgaria Tharindu Ranasinghe, Lancaster University, UK (Workshops Chair and Shared tasks Co-Chair) Saad Ezzini, KFUPM, Saudi Arabia (Sponsorship Chair and Shared tasks Co-Chair) Maria Kunilovskaya, Saarland University, Germany (Publication Chair) Preslav Nakov, MBZUAI, Abu Dhabi, UAE Ivelina Nikolova, Bulgarian Academy of Sciences, Bulgaria Kiril Simov, Bulgarian Academy of Sciences, Bulgaria (Workshops Co-Chair) Petya Osenova, Bulgarian Academy of Sciences, Bulgaria (Workshops Co-Chair)

1 0

Job Opening for Data Scientist (with a focus on natural language processing)
by Menno Van Zaanen 17 Mar '25

17 Mar '25

Job Opening for Data Scientist (with a focus on natural language processing) Application link: https://bit.ly/4iUSSAN Application deadline: 20 April 2025 As a Data Scientist at the South African Centre for Digital Language Resources (SADiLaR) you will have the opportunity to initiate and lead projects focusing on Human Language Technology and Digital Humanities stemming from your own research interests. You will work closely together with a team of researchers as part of SADiLaR’s extended network, both on your own and commissioned projects. Dissemination of project results at national and international conferences will be encouraged and supported. This position is crucial for research and development in Human Language Technology and Digital Humanities, fields that form the essence of SADiLaR, which is a national Research Infrastructure supported by the Department of Science and Innovation. Read more at https://www.sadilar.org. KEY RESPONSIBILITIES: * Research: Research in the area of Human Language Technology and Digital Humanities. * Project work: Initiating and contributing to Human Language Technology and Digital Humanities projects. * Teaching: Teaching in the area of Human Language Technology and Digital Humanities. * Mentorship: Mentorship of researchers in the field of Human Language Technology and Digital Humanities. Minimum requirements * A PhD (NQF level 10) in one of the following fields: Computational Linguistics, Natural Language Processing, Human Language Technology, Digital Humanities, Data Science, Computer Science, Information Technology, Artificial Intelligence, or related fields. The PhD should have a focus on computational aspects of linguistics. * A minimum of (five) 5 years’ experience in the use of Python (other programming languages used within the computational linguistics or Digital Humanities domain can also be considered). * Evidence of peer-reviewed academic publications. * A minimum of (three) 3 years’ experience as a supervisor/co- supervisor of students or playing a mentorship/supervising role for individuals. * A minimum of (three) 3 years’ experience with using and/or developing computational tools. * A minimum of (three) 3 years experience related to research within the domain of Language Technology or Digital Humanities. * A minimum of (one) 1 year experience related to teaching or training within the domain of Language Technology or Digital Humanities. ADDED ADVANTAGE * Membership with Academic subject communities. Functional / Technical Competencies (Knowledge and Skills) * Advanced computer literacy. * Ability to lead research projects. * Experience in the presentation of research-based results at national and international conferences. * Experience with writing research reports. * Evidence of acquiring research funding. KEY BEHAVIOURAL COMPETENCIES: * Ability to work independently or as part of a team. * Ability to effectively liaise and communicate with public, students, colleagues, and other stakeholders at various levels and from diverse backgrounds. * Demonstration of language proficiency in order to function optimally in the various multilingual environments of SADiLaR. * Strong interest in the advancement of under-resourced South African languages. REMUNERATION The annual total remuneration package will be commensurate with the level of appointment as advertised and in line with the NWU policy guidelines. ENQUIRIES REGARDING JOB CONTENT MAY BE DIRECTED TO: Prof. Menno van Zaanen, E-mail: Menno.VanZaanen(a)nwu.ac.za ENQUIRIES REGARDING RECRUITMENT PROCESS MAY BE DIRECTED TO: Mr. Byron Louw, Tel No. 018 285 2304 CLOSING DATE: 20 April 2025 PLANNED COMMENCEMENT OF DUTIES: As soon as possible Kindly take note: applications must be submitted online through the official nwu vacancy website. Incomplete applications and those submitted through any other platform will not be considered. Application link: https://bit.ly/4iUSSAN -- Prof Menno van Zaanen menno.vanzaanen(a)nwu.ac.za Professor in Digital Humanities South African Centre for Digital Language Resources https://www.sadilar.org ________________________________ NWU PRIVACY STATEMENT: http://www.nwu.ac.za/it/gov-man/disclaimer.html DISCLAIMER: This e-mail message and attachments thereto are intended solely for the recipient(s) and may contain confidential and privileged information. Any unauthorised review, use, disclosure, or distribution is prohibited. If you have received the e-mail by mistake, please contact the sender or reply e-mail and delete the e-mail and its attachments (where appropriate) from your system. ________________________________

1 0

Call for Participation - RANLP 2025 Shared Tasks
by Ranasinghe, Tharindu 14 Mar '25

14 Mar '25

We invite researchers to participate in RANLP 2025 shared tasks. RANLP is one of the most influential and competitive NLP conferences. RANLP 2025 will take place in September 2025 at the Black Sea city of Varna. For the first time in RANLP history, we are organising a shared task campaign as part of the main conference. Researchers and practitioners from all areas of natural language processing and related communities are invited to participate. The following tasks have been accepted for RANLP 2025. 1. PolyHope-M: Bridging Hope Speech Detection Across Multiple Languages Organisers - Fazlourrahman Balouchzahi, Sabur Butt, Maaz Amjad, Luis Jose Gonzalez-Gomez, Abdul Gafar Manuel Meque, Helena Gomez-Adorno, Bharathi Raja Chakravarthi, Grigori Sidorov, Thomas Mandl, Ruba Priyadharshini and Saranya Rajiakodi Task website - https://www.codabench.org/competitions/5635/ 1. Multilingual Coreference Resolution Organisers - Vijay Sundar Ram, Pattabhi RK Rao and Sobha Lalitha Devi Task website - https://www.codabench.org/competitions/5759/ 1. Multi-Domain Detection of AI-Generated Text (M-DAIGT) Organisers - Salima Lamsiyah, Saad Ezzini, Abdelkader El Mahdaouy, Hamza Alami, Abdessamad Benlahbib, Samir El amrany, Salmane Chafik and Hicham Hammouchi Task website - https://ezzini.github.io/M-DAIGT/ 1. Identification of the severity of the depression in forum post Organisers - Isuri Anuradha, Hasintha Hewawasam, Deshan Koshala Sumanathilaka, Ruslan Mitkov, Paul Rayson and Saad Ezzini Task website - https://www.codabench.org/competitions/5894/ 1. Sentiment Analysis on Arabic Dialects in the Hospitality Domain: A Multi-Dialect Benchmark Organisers - Maram I. Alharbi, Salmane Chafik, Ruslan Mitkov, Tharindu Ranasinghe, Hansi Hettiarachchi and Saad Ezzini Task website - https://ahasis-42267.web.app/ For inquiries regarding the individual shared tasks, please contact the corresponding task organisers. Shared Task Proceedings At least one member from each team needs to register and attend the RANLP 2025 shared task (which will take place on 11, 12 or 13 September 2025) and present their work in order to include it in the proceedings. More information about the RANLP main conference and its co-located events are available at https://ranlp.org/ranlp2025/ Shared Task Chairs Dr Tharindu Ranasinghe, Lancaster University, UK Dr Saad Ezzini, King Fahd University of Petroleum and Minerals, Saudi Arabia RANLP 2024 Chairs Programme Committee Chair: Prof Dr Ruslan Mitkov, Lancaster University, UK Organising Committee Chair: Prof Dr Galia Angelova, Bulgarian Academy of Sciences, Bulgaria Dr Tharindu Ranasinghe Lancaster University

1 0

Fwd: 1st Call For Participation: Automatic Minuting Shared Task - AutoMin @ SIGDIAL 2025
by Laurent Besacier 14 Mar '25

14 Mar '25

> Third Run of the Automatic Minuting Shared Task - AutoMin @ SIGDIAL 2025 > A great opportunity to assess LLMs' ability to summarize and retrieve information from long contexts > We propose AutoMin 2025, the third instance of bi-annual shared task on meeting summarization into structured meeting minutes. We build upon our past experience from two previous AutoMins and add a new challenge to facilitate personalized access: answering questions about meeting content. > As in the previous editions, the tasks are run in English and Czech while the new question-answering task will be run monolingually (English-only) and cross-lingually (Czech questions about English meetings). > This challenge is highly relevant for assessing LLMs' ability to summarize and retrieve information from long contexts, equivalent to the length of an hour-long meeting. > A dedicated workshop is scheduled for August 28th, 2025, as part of SIGDIAL 2025: https://2025.sigdial.org <https://2025.sigdial.org/>. > > Challenge Website > https://ufal.github.io/automin-2025/ > > Tasks > We propose two main tasks. > Task A (minuting): The task consists of automatically creating minutes from multiparty meeting transcripts. The generated minute would be evaluated both via automatic and manual metrics. > Task B (question answering): The task consists in answering questions based on meeting transcripts. For this challenge, participants will be tasked with answering these questions either monolingually (English questions on English transcripts) or cross-lingually (Czech questions on English transcripts). Answers will be evaluated using a LLM-as-a-judge metric. > > > Participant registration > All participants should register using the following link <https://docs.google.com/forms/d/e/1FAIpQLSeMTa2DkXtZCMbBpTo5c853nOr3yq2N1dX…> > > Important Dates > Registration and CfP > From March 1st, 2025 > Training and Dev Data Available > March 1st, 2025 > Test Data Available > April 15th, 2025 > System Run and Output Submission > April 29th, 2025 > System Paper Submission > May 5th, 2025 > Result Announcement > May 22d, 2025 > Acceptance Notification of System Papers > June 2025 (TBA) > Camera Ready for System Papers > TBA > Event Date > August 28th, 2025 > > Publication > All teams will be required to submit a brief technical report describing their method. Details will be given on the challenge website soon. > > Organizers > Laurent Besacier, Naver Labs Europe, France > Ondřej Bojar, UFAL, Charles University, Czech Republic > Tirthankar Ghosal, Oak Ridge National Laboratory, USA > Marie Hledıkova, UFAL, Charles University, Czech Republic > Thibaut Thonet, Naver Labs Europe, France > > Contact > The organizers can be contacted via the following email address: automin(a)ufal.mff.cuni.cz > >

1 0

Re: SpeD 2025
by Laurent Besacier 13 Mar '25

13 Mar '25

bonjour Corneliu oui ça va bien j espère que toi aussi ! merci pour la sollictiation, j accepte avec plaisir ! et relire 2 articles est aussi ok pour moi ! amicalement et bon succès dans l’organisation de cet évènement Laurent > Le 11 mars 2025 à 16:56, Corneliu BURILEANU <corneliu.burileanu(a)yahoo.com> a écrit : > > Cher Laurent, > > J'espère que tu vas bien, ça faisait longtemps qu'on ne s'était pas vu... > > Nous continuons notre conférence SpeD. Cette année, ce sera du 19 au 22 octobre à Cluj-Napoca (pub.sped.ro) > > Nous serions très heureux si vous acceptiez de continuer à faire partie du Comité Scientifique de la Conférence ! > > Si vous êtes d’accord, nous pourrons également vous demander de procéder à 2 ou 3 évaluations des articles soumis à la Conférence. > > Bien sûr, je serais très heureux de vous voir à cette occasion, mais nous en parlerons d'ici là. > > Avec beaucoup d'amitié, > Corneliu >

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

SIGUL March 2025