Please share this invitation with your network
thanks
Eric Atwell, School of Computing, University of Leeds
________________________________
School of Computing Colloquium, University of Leeds, Friday 24.2.23 12:00 (UK)
Guest speaker: Dr Rana Malhas, Qatar University
Title: Arabic Reading Comprehension on the Holy Qur’an using CL-AraBERT
Abstract: In this talk, we tackle the problem of machine reading comprehension (MRC) on the Holy Qur’an to address the lack of Arabic datasets and systems for this important task. We construct QRCD as the first Qur’anic Reading Comprehension Dataset, composed of 1,337 question passage-answer triplets for 1,093 question-passage pairs, of which 14% are multi-answer questions. We then introduce CLassical-AraBERT (CL-AraBERT for short), a new AraBERTbased pre-trained model, which is further pre-trained on about 1.0B-word Classical Arabic (CA) dataset, to complement the Modern Standard Arabic (MSA) resources used in pre-training the initial model, and make it a better fit for the task. Finally, we leverage cross-lingual transfer learning from MSA to CA, and fine-tune CL-AraBERT as a reader using two MSA-based MRC datasets followed by our QRCD dataset to constitute the first (to the best of our knowledge) MRC system on the Holy Qur’an. To evaluate our system, we introduce Partial Average Precision (𝑝𝐴𝑃 ) as an adapted version of the traditional rank-based Average Precision measure, which integrates partial matching in the evaluation over multi-answer and single-answer MSA questions. Adopting two experimental evaluation setups (hold-out and cross validation (CV)), we empirically show that the fine-tuned CL-AraBERT reader model significantly outperforms the baseline fine-tuned AraBERT reader model by 6.12 and 3.75 points in 𝑝𝐴𝑃 scores, in the hold-out and CV setups, respectively. To promote further research on this task and other related tasks on Qur’an and Classical Arabic text, we make both the QRCD dataset and the pre-trained CL-AraBERT model publicly available.
________________________________________________________________________________ Microsoft Teams meeting Join on your computer, mobile app or room device Click here to join the meetinghttps://emea01.safelinks.protection.outlook.com/ap/t-59584e83/?url=https%3A%2F%2Fteams.microsoft.com%2Fl%2Fmeetup-join%2F19%253ameeting_NThkMTFjZDItODE3NC00ODEyLWIzZGYtZmExM2E0ZDJjMmYy%2540thread.v2%2F0%3Fcontext%3D%257b%2522Tid%2522%253a%2522bdeaeda8-c81d-45ce-863e-5232a535b7cb%2522%252c%2522Oid%2522%253a%252251c5d094-79db-4590-8c4b-ac4fcdd849e8%2522%257d&data=05%7C01%7CE.S.Atwell%40leeds.ac.uk%7Cb44fe716776249c4728008db14f67dff%7Cbdeaeda8c81d45ce863e5232a535b7cb%7C1%7C0%7C638126821133644521%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bsMBRN%2FHbQ%2BgCT5Po8IwHczQiKS4JPUnFJbMzYmQAiU%3D&reserved=0 Meeting ID: 355 926 814 82 Passcode: 4dJRfD Download Teamshttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.microsoft.com%2Fen-us%2Fmicrosoft-teams%2Fdownload-app&data=05%7C01%7CE.S.Atwell%40leeds.ac.uk%7Cb44fe716776249c4728008db14f67dff%7Cbdeaeda8c81d45ce863e5232a535b7cb%7C1%7C0%7C638126821133644521%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HQ2DbNNdWQ8%2BAc1Sp7K7BgXDcHc9lxPPF4xT%2F14OChw%3D&reserved=0 | Join on the webhttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.microsoft.com%2Fmicrosoft-teams%2Fjoin-a-meeting&data=05%7C01%7CE.S.Atwell%40leeds.ac.uk%7Cb44fe716776249c4728008db14f67dff%7Cbdeaeda8c81d45ce863e5232a535b7cb%7C1%7C0%7C638126821133644521%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=UE%2BC8RjZtM9coF4ZWn2GTFy7gM2VaUmGHeanqSfW2Rc%3D&reserved=0 Learn morehttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Faka.ms%2FJoinTeamsMeeting&data=05%7C01%7CE.S.Atwell%40leeds.ac.uk%7Cb44fe716776249c4728008db14f67dff%7Cbdeaeda8c81d45ce863e5232a535b7cb%7C1%7C0%7C638126821133800755%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mvuLiWhC%2B55w7Vhpar3O34h5KOIy%2BP7wLCPB1gYvX%2F8%3D&reserved=0 | Meeting optionshttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteams.microsoft.com%2FmeetingOptions%2F%3ForganizerId%3D51c5d094-79db-4590-8c4b-ac4fcdd849e8%26tenantId%3Dbdeaeda8-c81d-45ce-863e-5232a535b7cb%26threadId%3D19_meeting_NThkMTFjZDItODE3NC00ODEyLWIzZGYtZmExM2E0ZDJjMmYy%40thread.v2%26messageId%3D0%26language%3Den-GB&data=05%7C01%7CE.S.Atwell%40leeds.ac.uk%7Cb44fe716776249c4728008db14f67dff%7Cbdeaeda8c81d45ce863e5232a535b7cb%7C1%7C0%7C638126821133800755%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=xqRXA%2FIepbzGT7fYuGPifMCfWMTBGq98vAI9nsmnNnA%3D&reserved=0 ________________________________________________________________________________