[apologies if you received multiple copies of this call]
Dear colleagues and friends,
*We are pleased to release the 2nd Call for Participation - LLMs4OL Challenge collocated with The International Semantic Web Conference (ISWC 2024)*
*Overview:* LLMs4OL stands for "Large Language Models for Ontology Learning." The LLMs4OL paradigm was first introduced in our research paper ( https://link.springer.com/chapter/10.1007/978-3-031-47240-4_22) published in the ISWC 2023 main conference proceedings. In this context, we aimed to test the readiness of LLMs to address the Ontology Learning (OL) task w.r.t. three main subtasks: 1) Term Typing, 2) Type Taxonomy Discovery, and 3) Non-Taxonomic Relation Extraction. Therein our evaluations included ontolgies from various knowledge domains, i.e. lexicosemantics (WordNet), geography (GeoNames), biomedicine (NCI, MEDICIN, SNOMEDCT), and web content types (schema.org). With the ISWC-LLMs4OL 2024 challenge, we aim to catalyze community-wide engagement in validating and expanding the use of LLMs in OL by releasing our evaluation datasets publicly in the community. This initiative is poised to advance our comprehension of LLMs’ roles within the Semantic Web, encouraging innovation and collaboration in developing scalable and accurate OL methods.
More info on the task website: https://sites.google.com/view/llms4ol/
The LLMs4OL Challenge will be divided into two evaluation phases:
- Evaluation Phase 1: Few-shot Testing; - Evaluation Phase 2: Zero-shot Testing
*Dates*
Training datasets available: March 30, 2024 Test data available (Task A): May 27, 2024 Evaluation ends (Task A): June 4, 2024 Test data available (Tasks B & C): June 5, 2024 Evaluation ends (Tasks B & C): June 18, 2024 Participant papers due: June 28, 2024 Notification to authors: July 19, 2024 Camera ready due: July 30, 2024 ISWC 2024, Baltimore, Maryland, USA: 11-15 November 2024
*Task Organizers*
Hamed Babaei Giglou (TIB Leibniz Information Centre for Science and Technology - Germany) Jennifer D’Souza (TIB Leibniz Information Centre for Science and Technology - Germany) Sören Auer (TIB Leibniz Information Centre for Science and Technology - Germany)
We look forward to having you on board!
*Contact:* llms4ol.challenge [at] gmail.com