Call for Participation - VarDial Evaluation Campaign 2024
The VarDial 2024 organizers are excited to announce the two shared tasks of the 2024 evaluation campaign:
1. The DIALECT-COPA shared task on dialectal causal commonsense reasoning
The shared task invites the community to propose, develop, and test approaches for adapting models for causal commonsense language understanding to three dialects of South-Slavic languages: the Slovenian Cerkno dialect, the Croatian Chakavian dialect, and the Serbian, Macedonian and Bulgarian Torlak dialect. Training and development data based on the COPA (Choice of plausible alternatives, Roemmele et al. 2011) dataset are available for four related standard languages (Slovenian, Croatian, Serbian, Macedonian) and two out of the three testing dialects (Cerkno, Torlak), the Chakavian dialect serving as a surprise dialect.
Details: https://sites.google.com/view/vardial-2024/shared-tasks/dialect-copa
Registration: https://forms.gle/UcLYcPgDFJoiAVip7
Organisers: Nikola Ljubešić, Jožef Stefan Institute, Ljubljana Ivan Vulić, University of Cambridge Goran Glavaš, University of Würzburg
2. DSL-ML - Multi-label classification of similar languages
The DSL-ML task is a multi-label extension of the classic "Discriminating similar languages" task that has been popular with VarDial since the beginnings of the workshop. The motivation behind this new task formulation is that some texts do not present any linguistic markers to unambiguously determine their origin. It therefore makes sense to predict several possible labels for such texts. The 2024 DSL-ML task is based on multi-label conversions of existing datasets from five different macro-languages: English, Spanish, Portuguese, French and BCMS (Bosnian, Croatian, Montenegrin, Serbian).
Details: https://sites.google.com/view/vardial-2024/shared-tasks/dsl-ml
Registration: https://forms.gle/UcLYcPgDFJoiAVip7
Organizers: Adrian Chifu, Aix-Marseille University Radu Ionescu, University of Bucharest Aleksandra Miletić, University of Helsinki Filip Miletić, University of Stuttgart Yves Scherrer, University of Oslo
Important dates
Shared task announcement and training data release: February 1 Test data release: March 4 Test results submission: March 11 System description paper submission: March 24 Notification of acceptance: April 14 Camera-ready papers due: April 24 VarDial workshop: June 21/22