Dear colleagues,

You are invited to participate in ArAIEval Shared Task at the ArabicNLP 2024:

(i) detection of propagandistic textual spans with persuasion techniques identification (unimodal) on Arabic news articles and tweets.

(ii) distinguishing between propagandistic and non-propagandistic memes (multimodal) in Arabic.

The shared task will be held alongside the Second Arabic Natural Language Processing Conference (ArabicNLP 2024), co-located with the ACL2024 Conference in Bangkok, Thailand (11-16 Aug, 2024).

Tasks

Task 1: Unimodal (Text) Propagandistic Technique Detection:

The task is to detect the propaganda techniques used in a text and identify the exact span(s) in which each propaganda technique appears. You will be given text snippets from news paragraphs or tweets (multigenre). This is a sequence tagging task.

Task 2: Multimodal propagandistic memes classification:

We offer the three subtasks as defined below:

-

Subtask 2A: Given a text extracted from a meme, detect whether it is propagandistic or not. -

Subtask 2B: Given a meme (text overlayed image), the task is to detect whether the content is propagandistic. -

Subtask 2C: Given multimodal content (text extracted from meme and the meme itself) the task is to detect whether the content is propagandistic.

Website for detailed information: https://araieval.gitlab.io/

Registration and submission:

Task 1: https://codalab.lisn.upsaclay.fr/competitions/18111

Task 2: https://codalab.lisn.upsaclay.fr/competitions/18099

Important Dates:

-

15 Mar 2024: Registration on CodaLab and the start of the development cycle (release of training and development datasets, along with submission for the development phase on CodaLab) -

27 April 2023 23:59 AOE: Beginning of the evaluation cycle (test sets release) -

1 May 2024 23:59 AOE: End of the evaluation cycle (run submission) -

5 May 2024: Release leaderboard -

15 May 2024: Deadline for the submission of shared task papers -

17 June 2024: Notification of acceptance of shared task papers -

1 July 2024: Deadline for submission of camera-ready papers -

16 August 2023: ArabicNLP Conference (colocated with ACL-2024)

Organizers

-

Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar -

Maram Hasanain, Qatar Computing Research Institute, HBKU, Qatar -

Reem Suwaileh, HBKU, Qatar -

Md. Arid Hasan, University of New Brunswick, Canada -

Fatema Ahmed, Qatar Computing Research Institute, HBKU, Qatar -

Md. Rafiul Biswas, HBKU, Qatar -

Wajdi Zaghouani, HBKU, Qatar

Regards,

The ArAIEval Shared Task Organizers