Dear corpora-list members,
We are glad to announce SemEval shared task 11: Bridging the Gap in Text-Based Emotion Detection https://github.com/emotion-analysis-project/SemEval2025-Task11. New textual datasets will be provided for 33 languages: Afrikaans https://en.wikipedia.org/wiki/Afrikaans, Algerian Arabic https://en.wikipedia.org/wiki/Algerian_Arabic, Amharic https://en.wikipedia.org/wiki/Amharic, Hausa https://en.wikipedia.org/wiki/Hausa_language, Igbo https://en.wikipedia.org/wiki/Igbo_language, Kinyarwanda https://en.wikipedia.org/wiki/Kinyarwanda, Moroccan Arabic https://en.wikipedia.org/wiki/Moroccan_Arabic, Mozambican Portuguese https://en.wikipedia.org/wiki/Mozambican_Portuguese, Nigerian-Pidgin https://en.wikipedia.org/wiki/Nigerian_Pidgin, Oromo https://en.wikipedia.org/wiki/Oromo_language, Setswana https://en.wikipedia.org/wiki/Tswana_language, Somali https://en.wikipedia.org/wiki/Somali_language, Swahili https://en.wikipedia.org/wiki/Swahili_language, Tigrinya https://en.wikipedia.org/wiki/Tigrinya_language,Xitsonga https://en.wikipedia.org/wiki/Tsonga_language, isiXhosa https://en.wikipedia.org/wiki/Xhosa_language, Yoruba https://en.wikipedia.org/wiki/Yoruba_language, isiZulu https://en.wikipedia.org/wiki/Zulu_language, Modern Standard Arabic https://en.wikipedia.org/wiki/Arabic, Chinese https://en.wikipedia.org/wiki/Chinese_language, Hindi https://en.wikipedia.org/wiki/Hindi, Indonesian https://en.wikipedia.org/wiki/Indonesian_language, Javanese https://en.wikipedia.org/wiki/Javanese_language, Marathi https://en.wikipedia.org/wiki/Marathi_language English https://en.wikipedia.org/wiki/English_language, German https://en.wikipedia.org/wiki/German_language, Romanian https://en.wikipedia.org/wiki/Romanian_language, Russian https://en.wikipedia.org/wiki/Russian_language, Latin American Spanish https://en.wikipedia.org/wiki/Spanish_language_in_the_Americas, Tatar https://en.wikipedia.org/wiki/Tatar_language, Ukrainian https://en.wikipedia.org/wiki/Ukrainian_language, Swedish https://en.wikipedia.org/wiki/Swedish_language Brazilian Portuguese https://en.wikipedia.org/wiki/Brazilian_Portuguese.
This shared task is on perceived emotion and focuses on:
-
Determining what emotion most people will think the speaker may be feeling given a sentence or short text snippet uttered by the speaker.
The task is *not about*:
-
The emotion evoked in the reader. -
The emotion of someone else mentioned in the text. -
Or even the true emotion of the speaker (which cannot be definitively known from just a short text snippet).
We acknowledge the importance of this distinction as perceived emotions can differ from actual emotions due to various factors such as cultural context, individual differences in emotional expression, and the limitations of text-based communication. (See more here https://github.com/emotion-analysis-project/SemEval2025-Task11?tab=readme-ov-file#bridging-the-gap-in-text-based-emotion-detection .)
Participants can participate in one or more of the following tracks: Track A: Multi-label Emotion Detection
Given a target text snippet, predict the perceived emotion(s) of the speaker. A training dataset with gold emotion labels will be provided for this track. Track B: Emotion Intensity
Given a target text and a target perceived emotion, predict the intensity for each of the classes.
*Track C: Cross-lingual Emotion Detection*
Given a labeled training set in one of the languages, predict the perceived emotion labels of a new text instance in a different target language.
*Important Dates and Phases of the Task*
Description
Deadline
Sample Data Ready
15 July 2024
Training Data Ready
10 September 2024
Evaluation Start
10 January 2025
Evaluation End
31 January 2025
System Description Paper Due
28 February 2025
Notification to authors
31 March 2025
Camera ready due
21 April 2025
SemEval workshop 2025
(co-located with a major NLP conference)
*Note that our task is inclusive and junior-friendly. We will organise a QA session with the participants before the competition starts and we will organise a system description writing tutorial.*Data
Available on https://github.com/emotion-analysis-project/SemEval2025-Task11 Useful Links for the participants
*Contact Organisers *emotion-semeval-2025-organisers@googlegroups.com
*Twitter/X* @EmoSemEval2025 https://x.com/EmoSemEval2025
FAQs https://github.com/emotion-analysis-project/SemEval2025-Task11?tab=readme-ov-file#faqs and Terms and Conditions https://github.com/emotion-analysis-project/SemEval2025-Task11?tab=readme-ov-file#competition-rules-and-terms
*Competition webpage* https://www.codabench.org/competitions/3863/
*Discord* https://discord.gg/wnVUerj5Rz
*Google Group* emotion-semeval-2025-participants@googlegroups.com
Best regards,
The Organisers: Shamsuddeen Hassan Muhammad, Seid Muhie Yimam , Nedjma Ousidhoum, Idris Abdulmumin, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Alham Fikri Aji, Felermino Ali, Vladimir Araujo, Abinew Ali Ayele, Tadesse Destaw Belay, Meriem Beloucif, Christine de Kock, Oana Ignat, Vukosi Marivate, Alexander Panchenko, Terry Ruas, Nirmal Surange, Daniela Teodorescu, Jan Philip Wahle, Yi Zhou, Saif M. Mohammad.