Dear corpora-list members,

We are glad to announce SemEval shared task 11: Bridging the Gap in Text-Based Emotion Detection https://github.com/emotion-analysis-project/SemEval2025-Task11. New textual datasets will be provided for 33 languages: Afrikaans https://en.wikipedia.org/wiki/Afrikaans, Algerian Arabic https://en.wikipedia.org/wiki/Algerian_Arabic, Amharic https://en.wikipedia.org/wiki/Amharic, Hausa https://en.wikipedia.org/wiki/Hausa_language, Igbo https://en.wikipedia.org/wiki/Igbo_language, Kinyarwanda https://en.wikipedia.org/wiki/Kinyarwanda, Moroccan Arabic https://en.wikipedia.org/wiki/Moroccan_Arabic, Mozambican Portuguese https://en.wikipedia.org/wiki/Mozambican_Portuguese, Nigerian-Pidgin https://en.wikipedia.org/wiki/Nigerian_Pidgin, Oromo https://en.wikipedia.org/wiki/Oromo_language, Setswana https://en.wikipedia.org/wiki/Tswana_language, Somali https://en.wikipedia.org/wiki/Somali_language, Swahili https://en.wikipedia.org/wiki/Swahili_language, Tigrinya https://en.wikipedia.org/wiki/Tigrinya_language,Xitsonga https://en.wikipedia.org/wiki/Tsonga_language, isiXhosa https://en.wikipedia.org/wiki/Xhosa_language, Yoruba https://en.wikipedia.org/wiki/Yoruba_language, isiZulu https://en.wikipedia.org/wiki/Zulu_language, Modern Standard Arabic https://en.wikipedia.org/wiki/Arabic, Chinese https://en.wikipedia.org/wiki/Chinese_language, Hindi https://en.wikipedia.org/wiki/Hindi, Indonesian https://en.wikipedia.org/wiki/Indonesian_language, Javanese https://en.wikipedia.org/wiki/Javanese_language, Marathi https://en.wikipedia.org/wiki/Marathi_language English https://en.wikipedia.org/wiki/English_language, German https://en.wikipedia.org/wiki/German_language, Romanian https://en.wikipedia.org/wiki/Romanian_language, Russian https://en.wikipedia.org/wiki/Russian_language, Latin American Spanish https://en.wikipedia.org/wiki/Spanish_language_in_the_Americas, Tatar https://en.wikipedia.org/wiki/Tatar_language, Ukrainian https://en.wikipedia.org/wiki/Ukrainian_language, Swedish https://en.wikipedia.org/wiki/Swedish_language Brazilian Portuguese https://en.wikipedia.org/wiki/Brazilian_Portuguese.

This shared task is on perceived emotion and focuses on:

-

Determining what emotion most people will think the speaker may be feeling given a sentence or short text snippet uttered by the speaker.

The task is *not about*:

-

The emotion evoked in the reader. -

The emotion of someone else mentioned in the text. -

Or even the true emotion of the speaker (which cannot be definitively known from just a short text snippet).

We acknowledge the importance of this distinction as perceived emotions can differ from actual emotions due to various factors such as cultural context, individual differences in emotional expression, and the limitations of text-based communication. (See more here https://github.com/emotion-analysis-project/SemEval2025-Task11?tab=readme-ov-file#bridging-the-gap-in-text-based-emotion-detection .)

Participants can participate in one or more of the following tracks: Track A: Multi-label Emotion Detection

Given a target text snippet, predict the perceived emotion(s) of the speaker. A training dataset with gold emotion labels will be provided for this track. Track B: Emotion Intensity

Given a target text and a target perceived emotion, predict the intensity for each of the classes.

*Track C: Cross-lingual Emotion Detection*

Given a labeled training set in one of the languages, predict the perceived emotion labels of a new text instance in a different target language.

*Important Dates and Phases of the Task*

Description

Deadline

Sample Data Ready

15 July 2024

Training Data Ready

10 September 2024

Evaluation Start

10 January 2025

Evaluation End

31 January 2025

System Description Paper Due

28 February 2025

Notification to authors

31 March 2025

Camera ready due

21 April 2025

SemEval workshop 2025

(co-located with a major NLP conference)

*Note that our task is inclusive and junior-friendly. We will organise a QA session with the participants before the competition starts and we will organise a system description writing tutorial.*Data

Available on https://github.com/emotion-analysis-project/SemEval2025-Task11 Useful Links for the participants

*Contact Organisers *emotion-semeval-2025-organisers@googlegroups.com

*Twitter/X* @EmoSemEval2025 https://x.com/EmoSemEval2025

FAQs https://github.com/emotion-analysis-project/SemEval2025-Task11?tab=readme-ov-file#faqs and Terms and Conditions https://github.com/emotion-analysis-project/SemEval2025-Task11?tab=readme-ov-file#competition-rules-and-terms

*Competition webpage* https://www.codabench.org/competitions/3863/

*Discord* https://discord.gg/wnVUerj5Rz

*Google Group* emotion-semeval-2025-participants@googlegroups.com

Best regards,

The Organisers: Shamsuddeen Hassan Muhammad, Seid Muhie Yimam , Nedjma Ousidhoum, Idris Abdulmumin, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Alham Fikri Aji, Felermino Ali, Vladimir Araujo, Abinew Ali Ayele, Tadesse Destaw Belay, Meriem Beloucif, Christine de Kock, Oana Ignat, Vukosi Marivate, Alexander Panchenko, Terry Ruas, Nirmal Surange, Daniela Teodorescu, Jan Philip Wahle, Yi Zhou, Saif M. Mohammad.