(Apologies for cross-posting)
-----------------------------------------------------------------------------------------
EVALITA 2023
Evaluation of NLP and Speech Tools for Italian
-----------------------------------------------------------------------------------------
***EVALITA 2023 - Call for Interest***
Following the success of the previous editions, we are pleased to announce EVALITA 2023, the eighth evaluation campaign of Natural Language Processing and Speech tools for Italian.
The general objective of EVALITA (http://www.evalita.it http://www.evalita.it/) is to promote the development of language technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner. EVALITA is an initiative of theItalian Association for Computational Linguistics http://www.ai-lc.it/(AILC).
In the context of EVALITA 2023 we are organising the following tasks (https://www.evalita.it/campaigns/evalita-2023/tasks/ https://www.evalita.it/campaigns/evalita-2023/tasks/):
*
DisCoTEX: Assessing DIScourse COherence in Italian TEXts. (https://sites.google.com/view/discotex/home?pli=1 https://sites.google.com/view/discotex/home?pli=1)
*
EMit 2022: Emotion Detection in Italian Tweets (http://www.di.unito.it/~tutreeb/emit23/index.html http://www.di.unito.it/~tutreeb/emit23/index.html).
*
HODI: Homotransphobia Detection in Italian. (https://hodi-evalita.github.io/ https://hodi-evalita.github.io/)
*
ACTI: Automatic Conspiracy Theory Identification. (https://russogiuseppe.github.io/ACTI/ https://russogiuseppe.github.io/ACTI/)
*
WiC-ITA: Word in Context for Italian. (https://wic-ita.github.io/ https://wic-ita.github.io/)
*
GeoLingIt: Geolocation of Linguistic Variation in Italy. (https://sites.google.com/view/geolingit https://sites.google.com/view/geolingit)
*
LangLearn: Language Learning Development. (https://sites.google.com/view/langlearn2023?pli=1 https://sites.google.com/view/langlearn2023?pli=1)
*
MULTI-Fake-DetectiVE: MULTImodal Fake News Detection and VErification. (https://sites.google.com/unipi.it/multi-fake-detective/home https://sites.google.com/unipi.it/multi-fake-detective/home)
*
NERMuD: Named-Entities Recognition on Multi-Domain Documents. (https://nermud.fbk.eu/ https://nermud.fbk.eu/)
*
Haspeede3: Hate Speech Detection. (https://di.unito.it/haspeede23 https://di.unito.it/haspeede23)
*
CLinkaRT:Linking a Lab Result to its Test Event in the Clinical Domain. (https://e3c.fbk.eu/clinkart https://e3c.fbk.eu/clinkart)
*
PoliticIT: PoliticIT. Political ideology detection in Italian texts.(https://codalab.lisn.upsaclay.fr/competitions/8507 https://codalab.lisn.upsaclay.fr/competitions/8507)
*
EmotivITA: Dimensional and Multi-dimensional emotion analysis. (https://sites.google.com/view/emotivita https://sites.google.com/view/emotivita)
As with other international evaluation campaigns, guidelines describing the different tasks will be distributed among the participants.
Participants to the tasks will also be provided with training data and will have the chance to test their systems according to the metrics and procedures to be used in the formal evaluation.
The results of the evaluation will be disseminated at the final workshop, which will be organised in Parma on 7th-8th September 2023.
We encourage participation from both academic institutions and industrial organisations. Please visit the EVALITA web site where information about all tasks is currently available, and indicate your intention to participate and the specific task(s) you are interested in. You can do so by filling out the form at the following link, which will be available until April 30th 2023:
https://forms.gle/TW2NveAZMZodF7Z59 https://forms.gle/TW2NveAZMZodF7Z59
Your expression of interest is not at all binding and you can participate in any of the tasks, but it’s very important to us to best organise this evaluation campaign.
IMPORTANT DATES:
*
February 7th, 2023: release of training data
*
May 2nd-9th, 2023: first evaluation window
*
May 7th-14th, 2023: second evaluation window
*
May 12th-19th, 2023: third evaluation window
*
May 30th, 2023: results to participants
*
June 14th, 2023: submission of participants’ report
*
July 10th, 2023: reviews to participants
*
July 25th, 2023: camera ready
*
September 7th-8th, 2023: workshop
EVALITA 2023 Chairs:
*
Mirko Lai (Università di Torino)
*
Stefano Menini (Fondazione Bruno Kessler)
*
Marco Polignano (Università di Bari Aldo Moro)
*
Valentina Russo (Logogramma SRL)
*
Rachele Sprugnoli (Università degli Studi di Parma)
*
Giulia Venturi (Istituto di Linguistica Computazionale “A. Zampolli” – CNR)
Contact:
evalita2023[AT]gmail.com http://gmail.com/
FOLLOW US!
Twitter: @EVALITAcampaign