[Apologies for cross-posting]
== Second Call for Papers and Extended Abstracts ==
1st Workshop on Automatic Assessment of Atypical Speech (AAAS-2025)
We would like to invite you to submit papers to AAAS workshop co-located with NoDaLiDa/Baltic-HLThttps://www.nodalida-bhlt2025.eu in Hestia Hotel Europa in Tallinn, Estonia on March 5th, 2025.
Workshop website: https://teflon.aalto.fi/aaas-2025/
== Important Dates ==
Submission DL: 16 December 2024 (both papers and abstracts) Notification of acceptance: 24 January 2025 Camera-ready DL: 3 February 2025 Workshop: 5 March 2025 (full day) All deadlines are 11:55PM UTC-12:00 ("anywhere on Earth").
== Overview ==
Automatic Assessment of Atypical Speech (AAAS) explores the assessment of pronunciation and speaking skills of children, language learners, people with speech sound disorders and methods to provide automatic rating and feedback using automatic speech recognition (ASR) and large language models (LLMs). Automatic speaking assessment (ASA) is a rapidly growing field that answers to the need of developing AI tools for self-practising second and foreign language skills. This is not limited to pronunciation assessment, but the AI tools can also provide more complex feedback about fluency, vocabulary and grammar of the recorded speech. ASA is also very relevant for detection and quantification of speech disorders and for developing speech exercises that can be performed independent of time and place. The important applications of non-standard speech also include interfaces for children and elderly speakers as an alternative to using text input and output. The topic is timely, because the latest large speech models allow us now to develop ASR and classification methods for low-resourced data, such as atypical speech, where annotated training datasets are rarely available and expensive and difficult to produce and share. The goal of this workshop is to present the latest results in ASA and discuss the future work and collaboration between the researchers in Nordic and Baltic countries.
== Topics of Interest ==
In particular, we would like to invite students, researchers, and other experts and stakeholders to contribute papers and/or join the discussion on the following (and related) topics: Automatic speaking assessment (ASA) for L2 (second or foreign language) pronunciation ASA for spoken L2 proficiency ASA for speech sound disorders (SSD) Automatic speech recognition (ASR) for L2 learners ASR for children and young L2 learners ASA and ASR for Nordic and other low-resource languages and tasks Spoken L2 learning and speech therapy using games Automatic generation of verbal feedback for spoken L2 learners using LLMs
== Submission Details ==
We accept both short and long papers, as well as demo papers. The submissions must describe original and unpublished work.
Paper length: Short and demo papers up to 4 pages. Long papers up to 8 pages. References are not included in the page count, and the camera-ready versions of accepted papers will be added to the page to address reviewer comments.
Papers should describe original unpublished work or work-in-progress and will be peer-reviewed by at least two members of the program committee in a double-blind fashion. All accepted papers will be collected into a proceedings volume to be published in the ACL anthology. All submissions must follow the NoDaLida template, available in both LaTeX and MS Word. The links to the templates can be found here: https://drive.google.com/file/d/1osWGzuRnYRQGRS70Lx_pdQKrIT-NefKS/view https://www.overleaf.com/latex/templates/instructions-for-nodalida-baltic-hl...
The submission will be through EasyChair: https://easychair.org/conferences/?conf=aaas2025
We also invite submissions of maximum 2-page long extended non-anonymous abstracts with any number of pages for references describing work in progress, negative results and opinion pieces. The abstracts, which should follow the same formatting templates as the peer-reviewed papers, will be considered for presentation by the workshop organisers and the accepted ones will be posted on the workshop website. The abstracts can be based on results related to our theme and already published elsewhere. The abstracts will not be published in the proceedings, but only in the workshop program.
Please also consider volunteering to review 2-3 papers.
== Invited Speakers ==
We have the pleasure to announce two invited speakers:
1. Nina R. Benway: What is so hard about AI Speech Therapy? Evidence from Efficacy Trials. Nina R Benway, PhD CCC-SLP, is a Postdoctoral Fellow in Electrical and Computer Engineering with Dr. Carol Espy-Wilson. Nina completed her doctoral training in speech-language pathology (concentration: neuroscience) with Dr. Jonathan Preston at Syracuse University, focusing on clinical trials in children with chronic rhotic speech sound disorders. The three studies of her dissertation resulted in the curation of an open-access 175,000-utterance speech corpus, the engineering of audio classification algorithms predicting speech-language pathologist perception of rhotic speech errors, and the clinical trial validation of an artificial intelligence tool that fully automates a speech sound treatment session. Nina’s doctoral training builds upon her undergraduate training in linguistics (acoustic phonetics) at Cornell University, graduate clinical training at The College of Saint Rose, and six years of clinical practice. Through these experiences Nina has refined a multidisciplinary skill set in speech science, speech signal processing, natural language processing, corpus phonetics, machine learning/artificial intelligence (AI), user interface development, cognitive frameworks of learning, and neurocomputational frameworks of speech production.
2. Ari Huhta: Automatic assessment of second/foreign language speaking: Review of developments for examination and teaching/learning purposes. Ari Huhta is a Professor of Language Assessment at the Centre for Applied Language Studies, University of Jyväskylä, Finland. His research interests include diagnostic foreign/second language (L2) assessment, computerised assessment, self-assessment, as well as the development of reading, writing and vocabulary knowledge in L2. He was involved in developing the large-scale multilingual DIALANG online assessment and feedback system in the early 2000s and since then he has specialised in assessments that support language learning. Although his research has focused on learning and assessing reading and writing, he has been involved in designing several rating scales for speaking and in evaluating rating quality and studying rater behavior. Recently, he has participated in research projects that are developing ASR and automated assessment of L2 speaking, as well as using LLMs to evaluate Finnish L2 learners’ proficiency level.
== Organizers ==
Mikko Kurimo (chair), Aalto University, mikko.kurimo@aalto.fi Giampiero Salvi, NTNU Sofia Strömbergsson, Karolinska Institutet Sari Ylinen, Tampere University Minna Lehtonen, University of Turku Tamas Grosz, Aalto University Ekaterina Voskoboinik, Aalto University Yaroslav Getman, Aalto University Nhan Phan, Aalto University
This workshop is supported by “Technology-enhanced foreign and second-language learning of Nordic languages (TEFLON)” https://teflon.aalto.fi/ NordForsk project nr. 103893.
== Contact Information ==
For questions and comments, please email mikko.kurimo@aalto.fi
[Apologies for cross-posting]
== Third Call for Papers and Extended Paper Update DL 20 December==
1st Workshop on Automatic Assessment of Atypical Speech (AAAS-2025)
We would like to invite you to submit papers to AAAS workshop co-located with NoDaLiDa/Baltic-HLThttps://www.nodalida-bhlt2025.eu in Hestia Hotel Europa in Tallinn, Estonia on March 5th, 2025.
Workshop website: https://teflon.aalto.fi/aaas-2025/
== Important Dates ==
Submission DL: 16 December 2024 (both papers and abstracts) NEW: Paper Update DL 20 December 2024 Notification of acceptance: 24 January 2025 Camera-ready DL: 3 February 2025 Workshop: 5 March 2025 (full day) All deadlines are 11:55PM UTC-12:00 ("anywhere on Earth").
== Overview ==
Automatic Assessment of Atypical Speech (AAAS) explores the assessment of pronunciation and speaking skills of children, language learners, people with speech sound disorders and methods to provide automatic rating and feedback using automatic speech recognition (ASR) and large language models (LLMs). Automatic speaking assessment (ASA) is a rapidly growing field that answers to the need of developing AI tools for self-practising second and foreign language skills. This is not limited to pronunciation assessment, but the AI tools can also provide more complex feedback about fluency, vocabulary and grammar of the recorded speech. ASA is also very relevant for detection and quantification of speech disorders and for developing speech exercises that can be performed independent of time and place. The important applications of non-standard speech also include interfaces for children and elderly speakers as an alternative to using text input and output. The topic is timely, because the latest large speech models allow us now to develop ASR and classification methods for low-resourced data, such as atypical speech, where annotated training datasets are rarely available and expensive and difficult to produce and share. The goal of this workshop is to present the latest results in ASA and discuss the future work and collaboration between the researchers in Nordic and Baltic countries.
== Topics of Interest ==
In particular, we would like to invite students, researchers, and other experts and stakeholders to contribute papers and/or join the discussion on the following (and related) topics: Automatic speaking assessment (ASA) for L2 (second or foreign language) pronunciation ASA for spoken L2 proficiency ASA for speech sound disorders (SSD) Automatic speech recognition (ASR) for L2 learners ASR for children and young L2 learners ASA and ASR for Nordic and other low-resource languages and tasks Spoken L2 learning and speech therapy using games Automatic generation of verbal feedback for spoken L2 learners using LLMs
== Submission Details ==
We accept both short and long papers, as well as demo papers. The submissions must describe original and unpublished work.
Paper length: Short and demo papers up to 4 pages. Long papers up to 8 pages. References are not included in the page count, and the camera-ready versions of accepted papers will be added to the page to address reviewer comments.
Papers should describe original unpublished work or work-in-progress and will be peer-reviewed by at least two members of the program committee in a double-blind fashion. All accepted papers will be collected into a proceedings volume to be published in the ACL anthology. All submissions must follow the NoDaLida template, available in both LaTeX and MS Word. The links to the templates can be found here: https://drive.google.com/file/d/1osWGzuRnYRQGRS70Lx_pdQKrIT-NefKS/view https://www.overleaf.com/latex/templates/instructions-for-nodalida-baltic-hl...
The submission will be through EasyChair: https://easychair.org/conferences/?conf=aaas2025
We also invite submissions of maximum 2-page long extended non-anonymous abstracts with any number of pages for references describing work in progress, negative results and opinion pieces. The abstracts, which should follow the same formatting templates as the peer-reviewed papers, will be considered for presentation by the workshop organisers and the accepted ones will be posted on the workshop website. The abstracts can be based on results related to our theme and already published elsewhere. The abstracts will not be published in the proceedings, but only in the workshop program.
Please also consider volunteering to review 2-3 papers.
== Invited Speakers ==
We have the pleasure to announce two invited speakers:
1. Nina R. Benway: What is so hard about AI Speech Therapy? Evidence from Efficacy Trials. Nina R Benway, PhD CCC-SLP, is a Postdoctoral Fellow in Electrical and Computer Engineering with Dr. Carol Espy-Wilson. Nina completed her doctoral training in speech-language pathology (concentration: neuroscience) with Dr. Jonathan Preston at Syracuse University, focusing on clinical trials in children with chronic rhotic speech sound disorders. The three studies of her dissertation resulted in the curation of an open-access 175,000-utterance speech corpus, the engineering of audio classification algorithms predicting speech-language pathologist perception of rhotic speech errors, and the clinical trial validation of an artificial intelligence tool that fully automates a speech sound treatment session. Nina’s doctoral training builds upon her undergraduate training in linguistics (acoustic phonetics) at Cornell University, graduate clinical training at The College of Saint Rose, and six years of clinical practice. Through these experiences Nina has refined a multidisciplinary skill set in speech science, speech signal processing, natural language processing, corpus phonetics, machine learning/artificial intelligence (AI), user interface development, cognitive frameworks of learning, and neurocomputational frameworks of speech production.
2. Ari Huhta: Automatic assessment of second/foreign language speaking: Review of developments for examination and teaching/learning purposes. Ari Huhta is a Professor of Language Assessment at the Centre for Applied Language Studies, University of Jyväskylä, Finland. His research interests include diagnostic foreign/second language (L2) assessment, computerised assessment, self-assessment, as well as the development of reading, writing and vocabulary knowledge in L2. He was involved in developing the large-scale multilingual DIALANG online assessment and feedback system in the early 2000s and since then he has specialised in assessments that support language learning. Although his research has focused on learning and assessing reading and writing, he has been involved in designing several rating scales for speaking and in evaluating rating quality and studying rater behavior. Recently, he has participated in research projects that are developing ASR and automated assessment of L2 speaking, as well as using LLMs to evaluate Finnish L2 learners’ proficiency level.
== Organizers ==
Mikko Kurimo (chair), Aalto University, mikko.kurimo@aalto.fi Giampiero Salvi, NTNU Sofia Strömbergsson, Karolinska Institutet Sari Ylinen, Tampere University Minna Lehtonen, University of Turku Tamas Grosz, Aalto University Ekaterina Voskoboinik, Aalto University Yaroslav Getman, Aalto University Nhan Phan, Aalto University
This workshop is supported by “Technology-enhanced foreign and second-language learning of Nordic languages (TEFLON)” https://teflon.aalto.fi/ NordForsk project nr. 103893.
== Contact Information ==
For questions and comments, please email mikko.kurimo@aalto.fi
[Apologies for cross-posting]
Call for Participation
IEEE-MLSP Non-native Children’s Automatic Speech Assessment Challenge (NOCASA) https://teflon.aalto.fi/nocasa-2025/
The IEEE-MLSP Non-native Children’s Automatic Speech Assessment Challenge (NOCASA) is an open Challenge aiming to develop new Speech Assessment tools for young language learners. The data consists of recordings of children of 5 – 12 years repeating the words in Norwegian that were played to them. The children include L1 speakers, beginner learners of L2 Norwegian and children who had no previous exposure to Norwegian. For each recording in the data, we provide the expected word’s orthographic transcription and the speech accuracy assessment score of 1 – 5, which is given by human experts. The task of the participants is to develop an automatic speech assessment system and use it to predict the score of each utterance in the given test data. For more details, please visit https://teflon.aalto.fi/nocasa-2025/ The results of the Challenge will be presented at the IEEE MLSP 2025 (https://2025.ieeemlsp.org/en/ ) conference in Istanbul.
To participate in the Challenge, email the organisers mailto:mikko.kurimo@aalto.fi.
Organisers:
Mikko Kurimo: mikko.kurimo@aalto.fi (Aalto University, Finland) Tamas Grosz: tamas.grosz@aalto.fi (Aalto University, Finland) Giampiero Salvi: giampiero.salvi@ntnu.no (NTNU, Norway)
This challenge is supported by “Technology-enhanced foreign and second-language learning of Nordic languages (TEFLON)” https://teflon.aalto.fi/ NordForsk project nr. 103893.
Important Dates:
Team registration starts: March 19. Training and test data released: March 19. Evaluation system opens: April 2. Baseline paper (and code) released: April 27. Paper submission deadline: May 20. Evaluation system closes, and the leaderboard is public: May 20. Post-Challenge evaluation phase: from May 20 until July 15. Notification of paper acceptance: June 24. Camera-ready upload July 15.
To get started:
Please register your team by email to Mikko Kurimo: mikko.kurimo@aalto.fimailto:mikko.kurimo@aalto.fi.
Then, please obtain the End-User License Agreement (EULA) (from https://teflon.aalto.fi/nocasa-2025/ ) to get access and further instructions for the download of the datasets: Please fill out electronically the PDF for the dataset you wish to obtain, and print, sign, scan, and email - to the email addresses indicated on the website. The agreement has to be signed by a permanent staff member.
After downloading the data, you can start your experiments directly with the data sets. Once you have found the best method, you should write and submit a technical paper for the Challenge Session at IEEE-MLSP. At the same time, you can test your models by uploading the test predictions to the submission system, and we will let you know the results of your models.
If you have questions, contact all of the Organizers (see above).
1st CFP: MLSP-AAAS-2025
IEEE MLSP Special Session on Automatic Assessment of Atypical Speech
Following the success of 1st AAAS workshop in March 2025, we’re happy to invite you to participate and submit papers to the AAAS Special Session at IEEE MLSP August 31 - September 3, 2025 in Istanbul.
The paper format is similar (max 6 pages incl. ref) as in the main MLSP. Submission DL 10 May, 2025. Please also consider volunteering to review 1-3 papers.
For details visit the special session page: https://teflon.aalto.fi/mlsp-aaas-2025/ and the main conference page: https://2025.ieeemlsp.org/ If you are interested in a shared task or data competition, check also the co-located NOCASA-2025: https://teflon.aalto.fi/nocasa-2025/
Mikko Kurimo (chair) and the organizing committee
-
Kurimo Mikko