Dear corpora-list members,

We are glad to announce SemEval shared task 11: Bridging the Gap in Text-Based Emotion Detection. New textual datasets will be provided for 33 languages: Afrikaans, Algerian Arabic, Amharic, Hausa, Igbo, Kinyarwanda, Moroccan Arabic, Mozambican Portuguese, Nigerian-Pidgin, Oromo, Setswana, Somali, Swahili, Tigrinya,Xitsonga, isiXhosa, Yoruba, isiZulu, Modern Standard Arabic, Chinese, Hindi, Indonesian, Javanese, Marathi English, German, Romanian, Russian, Latin American Spanish, Tatar, Ukrainian, Swedish Brazilian Portuguese.

This shared task is on perceived emotion and focuses on:

  • Determining what emotion most people will think the speaker may be feeling given a sentence or short text snippet uttered by the speaker.

The task is not about:

  • The emotion evoked in the reader.

  • The emotion of someone else mentioned in the text.

  • Or even the true emotion of the speaker (which cannot be definitively known from just a short text snippet).


We acknowledge the importance of this distinction as perceived emotions can differ from actual emotions due to various factors such as cultural context, individual differences in emotional expression, and the limitations of text-based communication. (See more here.)


Participants can participate in one or more of the following tracks:

Track A: Multi-label Emotion Detection

Given a target text snippet, predict the perceived emotion(s) of the speaker. A training dataset with gold emotion labels will be provided for this track.

Track B: Emotion Intensity

Given a target text and a target perceived emotion, predict the intensity for each of the classes.


Track C: Cross-lingual Emotion Detection

Given a labeled training set in one of the languages, predict the perceived emotion labels of a new text instance in a different target language.


Important Dates and Phases of the Task

Description

Deadline

Sample Data Ready

15 July 2024

Training Data Ready

10 September 2024

Evaluation Start

10 January 2025

Evaluation End

31 January 2025

System Description Paper Due

28 February 2025

Notification to authors

31 March 2025

Camera ready due

21 April 2025

SemEval workshop 2025

(co-located with a major NLP conference)


Note that our task is inclusive and junior-friendly. We will organise a QA session with the participants before the competition starts and we will organise a system description writing tutorial.

Data

Available on https://github.com/emotion-analysis-project/SemEval2025-Task11

Useful Links for the participants

Contact Organisers emotion-semeval-2025-organisers@googlegroups.com

Twitter/X  @EmoSemEval2025

FAQs and Terms and Conditions 

Competition webpage https://www.codabench.org/competitions/3863/

Discord https://discord.gg/wnVUerj5Rz

Google Group emotion-semeval-2025-participants@googlegroups.com

Best regards,

The Organisers: Shamsuddeen Hassan Muhammad, Seid Muhie Yimam , Nedjma Ousidhoum, Idris Abdulmumin, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Alham Fikri Aji, Felermino Ali, Vladimir Araujo, Abinew Ali Ayele, Tadesse Destaw Belay, Meriem Beloucif, Christine de Kock, Oana Ignat, Vukosi Marivate, Alexander Panchenko, Terry Ruas, Nirmal Surange, Daniela Teodorescu, Jan Philip Wahle, Yi Zhou, Saif M. Mohammad.