Dear colleagues,
You are invited to participate in ArAIEval Shared Task at the ArabicNLP 2024:
(i) detection of propagandistic textual spans with persuasion techniques identification (unimodal) on Arabic news articles and tweets.
(ii) distinguishing between propagandistic and non-propagandistic memes (multimodal) in Arabic.
The shared task will be held alongside the Second Arabic Natural Language Processing Conference (ArabicNLP 2024), co-located with the ACL2024 Conference in Bangkok, Thailand (11-16 Aug, 2024).
Tasks
Task 1: Unimodal (Text) Propagandistic Technique Detection:
The task is to detect the propaganda techniques used in a text and identify the exact span(s) in which each propaganda technique appears. You will be given text snippets from news paragraphs or tweets (multigenre). This is a sequence tagging task.
Task 2: Multimodal propagandistic memes classification:
We offer the three subtasks as defined below:
-
Subtask 2A: Given a text extracted from a meme, detect whether it is propagandistic or not. -
Subtask 2B: Given a meme (text overlayed image), the task is to detect whether the content is propagandistic. -
Subtask 2C: Given multimodal content (text extracted from meme and the meme itself) the task is to detect whether the content is propagandistic.
Website for detailed information: https://araieval.gitlab.io/
Registration and submission:
Task 1: https://codalab.lisn.upsaclay.fr/competitions/18111
Task 2: https://codalab.lisn.upsaclay.fr/competitions/18099
Important Dates:
-
15 Mar 2024: Registration on CodaLab and the start of the development cycle (release of training and development datasets, along with submission for the development phase on CodaLab) -
27 April 2023 23:59 AOE: Beginning of the evaluation cycle (test sets release) -
1 May 2024 23:59 AOE: End of the evaluation cycle (run submission) -
5 May 2024: Release leaderboard -
15 May 2024: Deadline for the submission of shared task papers -
17 June 2024: Notification of acceptance of shared task papers -
1 July 2024: Deadline for submission of camera-ready papers -
16 August 2023: ArabicNLP Conference (colocated with ACL-2024)
Organizers
-
Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar -
Maram Hasanain, Qatar Computing Research Institute, HBKU, Qatar -
Reem Suwaileh, HBKU, Qatar -
Md. Arid Hasan, University of New Brunswick, Canada -
Fatema Ahmed, Qatar Computing Research Institute, HBKU, Qatar -
Md. Rafiul Biswas, HBKU, Qatar -
Wajdi Zaghouani, HBKU, Qatar
Regards,
The ArAIEval Shared Task Organizers