[apologies if you received multiple copies of this call]
Dear colleagues and friends,
*We are pleased to release the 3rd Call for Participation - LLMs4OL Challenge collocated with The International Semantic Web Conference (ISWC 2024)*
*Overview:* LLMs4OL stands for "Large Language Models for Ontology Learning." The LLMs4OL paradigm was first introduced in our research paper ( https://link.springer.com/chapter/10.1007/978-3-031-47240-4_22) published in the ISWC 2023 main conference proceedings. In this context, we aimed to test the readiness of LLMs to address the Ontology Learning (OL) task w.r.t. three main subtasks: 1) Term Typing, 2) Type Taxonomy Discovery, and 3) Non-Taxonomic Relation Extraction. Therein our evaluations included ontolgies from various knowledge domains, i.e. lexicosemantics (WordNet), geography (GeoNames), biomedicine (NCI, MEDICIN, SNOMEDCT), and web content types (schema.org). With the ISWC-LLMs4OL 2024 challenge, we aim to catalyze community-wide engagement in validating and expanding the use of LLMs in OL by releasing our evaluation datasets publicly in the community. This initiative is poised to advance our comprehension of LLMs’ roles within the Semantic Web, encouraging innovation and collaboration in developing scalable and accurate OL methods.
More info on the task website: https://sites.google.com/view/llms4ol/
The LLMs4OL Challenge will be divided into two evaluation phases:
- Evaluation Phase 1: Few-shot Testing; - Evaluation Phase 2: Zero-shot Testing
*Dates (Extended!!)*
Training datasets available: March 30, 2024 Test data available (Task A): June 27, 2024 Evaluation ends (Task A): July 4, 2024 Test data available (Tasks B & C): July 5, 2024 Evaluation ends (Tasks B & C): July 18, 2024 Participant papers due: July 28, 2024 Notification to authors: August 19, 2024 Camera ready due: August 30, 2024 ISWC 2024, Baltimore, Maryland, USA: 11-15 November 2024
If you wish to compare the changes in schedule, the original timeline can be seen here https://sites.google.com/view/llms4ol/important-dates
*Task Organizers*
Hamed Babaei Giglou (TIB Leibniz Information Centre for Science and Technology - Germany) Jennifer D’Souza (TIB Leibniz Information Centre for Science and Technology - Germany) Sören Auer (TIB Leibniz Information Centre for Science and Technology - Germany)
We look forward to having you on board! Help us spread the word to other interested researchers within your network!
*Contact:* llms4ol.challenge [at] gmail.com