[apologies if you received multiple copies of this call]
Dear colleagues and friends,
We are pleased to release the 3rd
Call for Participation - LLMs4OL Challenge collocated with The
International Semantic Web Conference (ISWC 2024)
Overview:
LLMs4OL stands for "Large Language Models for Ontology Learning." The
LLMs4OL paradigm was first introduced in our research paper (https://link.springer.com/chapter/10.1007/978-3-031-47240-4_22)
published in the ISWC 2023 main conference proceedings. In this
context, we aimed to test the readiness of LLMs to address the Ontology
Learning (OL) task w.r.t. three main subtasks: 1) Term Typing, 2) Type
Taxonomy Discovery, and 3) Non-Taxonomic Relation Extraction. Therein
our evaluations included ontolgies from various knowledge domains, i.e.
lexicosemantics (WordNet), geography (GeoNames), biomedicine (NCI,
MEDICIN, SNOMEDCT), and web content types (schema.org).
With the ISWC-LLMs4OL 2024 challenge, we aim to catalyze community-wide
engagement in validating and expanding the use of LLMs in OL by
releasing our evaluation datasets publicly in the community. This
initiative is poised to advance our comprehension of LLMs’ roles within
the Semantic Web, encouraging innovation and collaboration in developing
scalable and accurate OL methods.
More info on the task website: https://sites.google.com/view/llms4ol/
The LLMs4OL Challenge will be divided into two evaluation phases:
- Evaluation Phase 1: Few-shot Testing;
- Evaluation Phase 2: Zero-shot Testing
Dates (Extended!!)
Training datasets available: March 30, 2024
Test data available (Task A): June 27, 2024
Evaluation ends (Task A): July 4, 2024
Test data available (Tasks B & C): July 5, 2024
Evaluation ends (Tasks B & C): July 18, 2024
Participant papers due: July 28, 2024
Notification to authors: August 19, 2024
Camera ready due: August 30, 2024
ISWC 2024, Baltimore, Maryland, USA: 11-15 November 2024
Task Organizers
Hamed Babaei Giglou (TIB Leibniz Information Centre for Science and Technology - Germany)
Jennifer D’Souza (TIB Leibniz Information Centre for Science and Technology - Germany)
Sören Auer (TIB Leibniz Information Centre for Science and Technology - Germany)
We look forward to having you on board! Help us spread the word to other interested researchers within your network!
Contact: llms4ol.challenge [at] gmail.com