Call for Papers

Special Issue of the TAL Journal: Explainability of NLP models

https://tal-64-3.sciencesconf.org/

** Deadline for submission: 15 October 2023 **

** Guest Editors **

Marianna Apidianaki, University of Pennsylvania Guillaume Wisniewski, Université Paris Cité, LLF

Neural models build language representations without direct supervision, and have contributed to the important advances of language and speech processing systems in recent years. The use of the representations built by pre-trained language models (such as BERT) allows the development of systems for many languages and domains. However, model decisions are not interpretable. It is often not possible to know why a system makes a specific decision, and the reasons behind the good performance of state-of-the-art models remain mostly unknown. An increasing number of studies attempt to provide answers to these questions by addressing the explicability of NLP systems, and exploring questions related to:

• model analysis and interpretability, aimed at identifying the information encoded in neural representations [1] ; • the development of methods aimed at describing and justifying the reasoning steps that allowed systems to reach a specific answer, for example with chain-of-thought prompting (model explicability) [2] ; • the development of "safe" systems, capable of self-justification (model accountability).

This special issue of the TAL journal aims to address explanation and analysis methods that have been proposed for NLP systems, as well as our current understanding of the linguistic capabilities of neural models and their limitations.

We welcome submissions on the following topics (non-exclusively):

• Methods aimed at explaining the decisions of neural networks (identification of important elements, explanation in textual format, …), and specifically methods that allow to establish causality relations between a prediction and the input (or part of the input); • Probing methods aimed at identifying linguistic and world knowledge encoded in neural representations; • Methods that allow to distinguish information that is encoded by neural networks, from information that is actually used by the models for making a decision (correlation versus causality); • Methods inspired by analysis methodology from related domains (experimental linguistics, computer vision, psychology, …); • Bias identification in neural language models; • Prompting methods to generate explanations with text [2] or structured representations [4]; • Study of artificial languages or of linguistically motivated examples; • Evaluation of explanation methods and especially methods aimed at evaluating the faithfulness of explanations.

[1] Interpretability and Analysis in Neural NLP (Belinkov et al., ACL 2020) [2] Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (Wei et al., NeurIPS 2022) [3] Towards Faithful Model Explanation in NLP: A Survey (Lyu et al., arxiv 2023) [4] Causal Reasoning of Entities and Events in Procedural Texts (Zhang et al., EACL Findings 2023)

** Important dates **

• Submission deadline: 15 October 2023 • Notification to the authors after first review: December 2023 • Notification to the authors after second review: February 2024 • Publication : April 2024

** Submission format **

The length of the papers must be between 20 and 25 pages. Style sheets are available on the journal's website (https://www.atala.org/content/instruction-authors-style-files-0).

Authors are invited to submit their paper on this platform: https://tal-64-3.sciencesconf.org/ To do so, authors will need to first create an account by clicking on "Create account" (Créer un compte) next to the “Login" (Connexion) button at the top of this page. To submit a paper, authors can connect to their account and upload their submission in "My Space" > "My submissions”.

The articles can be written in English or in French. Papers in English need to include a title and abstract in French.

The TAL journal has a double-blind review process. It is necessary to anonymize the article and the name of the file, and to avoid self-references. Each article is evaluated by three reviewers, two external reviewers and a member of the editorial board of the journal TAL.

** TAL Journal **

TAL (Traitement Automatique des Langues / Natural Language Processing) is an international journal published by ATALA (French Association for Natural Language Processing, http://www.atala.org) since 1959 with the support of CNRS (National Centre for Scientific Research). It has moved to an electronic mode of publication, with printing on demand. The TAL journal is open-access. Paper submission, publication and access are free of charge.

Papers published in the TAL journal will be made available on the ATALA website and on ACL Anthology.