more information on our Workshop-Website:
https://www.ids-mannheim.de/home/lexiktagungen/llm-fails
Dear list members,
we would like to invite you to submit abstracts to our workshop "LLM
fails – Failed experiments with Generative AI and what we can learn from
them" taking place from April 8-9, 2025 at the Leibniz Institute for the
German Language, Mannheim, Germany.
If the extended short papers are positively reviewed, there is an
opportunity to publish them in a special issue of the Journal for
Language Technology and Computational Linguistics.
Further information (automatic English translation):
Failed experiments typically have no place in scientific discourse; they
are discarded and not published. We believe this leads to a loss of
potential knowledge. After all, a systematic reflection on the reasons
for failure allows for the questioning and/or improvement of methods
used. Furthermore, when previously failed experiments are repeated and
succeed, explicit progress can be determined. Thus, the discussion and
documentation of failures creates added value for the scientific
community from the perspective of methodological reflection. This is
even more relevant in a field like research into and with Generative
Artificial Intelligence (AI), which cannot look back on decades of
tradition and where best practices are still being negotiated.
This workshop focuses on linguistic and NLP experiments with Generative
AI that did not yield the desired results, such as but not limited to:
• Using Generative AI as a Named-Entity Recognizer
• Using Generative AI for automatic transcription of spoken language
data
• Using Generative AI for the creation of dictionary entries
• Using Generative AI for the detection of language change phenomena
The contribution should clarify how this failure can contribute to
knowledge gain regarding the work with Generative AI.
Unpublished proposals can be submitted anonymously as an abstract
(500-750 words) in either German or English to the following email
address by December 11, 2024:
llmfails(at)ids-mannheim.de
The organization team will decide on the acceptance of contributions by
December 16, 2025. If a contribution is accepted, a short paper (4-6
pages without references) in English will be requested by February 15,
2025. The short papers will undergo double-blind peer review and will be
published in a special issue of the Journal for Language Technology and
Computational Linguistics and archived at ACL Anthology.
Best,
Annelen Brunner, Christian Lang, Ngoc Duyen Tanja Tu
(Organising committee)
--
Dr. Ngoc Duyen Tanja Tu
Leibniz-Institut für Deutsche Sprache
Abteilung Grammatik
Tel: +49 621-1581-242
I have a student who is interested in tracing the development of the
English novel from its origins to the present day (or at least to the
start of the twentieth century), and I'm trying to gather information
about relevant corpora covering this text type and period.
We know about the European Literary Text Collection (ELTeC,
https://www.distant-reading.net/eltec/) which will be very useful for
the later end of the timescale. We also know it is possible to assemble
a corpus from Project Gutenberg, archive.org, Oxford Text Archive, etc.
, but would be interested in re-using any corpora that people might
already have made, which aim to be representative of particular periods
within this genre.
The student has some flexibility with her research question, so while
the original idea of 'English novels' was probably 'novels in English
from Great Britain and Ireland', other related areas such as US novels
might be interesting as well.
Any tips and suggestions gratefully received. If we get a number of
interesting direct emails, I'll be happy to summarize the results to the
list.
Best wishes,
Martin
--
Senior Researcher in Corpus Linguistics
Faculty of Linguistics, Philology and Phonetics, University of Oxford
National Co-ordinator, CLARIN-UK
martin.wynne(a)ling-phil.ox.ac.uk
https://orcid.org/0000-0002-4155-0530