BlackboxNLP 2024: The 7th Workshop on Analyzing and Interpreting Neural Networks for NLP
*Last Call for Papers*: The seventh edition of the BlackboxNLP workshop, co-located with EMNLP 2024, in Miami on November 15, 2024. .
*Important dates*
---------------------
*August 15, 2024* - Paper submission deadline (through OpenReview).
September 20, 2024 - Notification of acceptance.
October 4, 2024 - Camera-ready deadline.
*November 15, 2024* - Workshop date.
All deadlines are 11:59PM UTC-12:00 (“Anywhere on Earth”). We will accept ARR submissions; corresponding deadlines will be announced at a later moment in time.
*Workshop description:*
-----------------
Many recent performance improvements in NLP have come at the cost of understanding of the systems. How do we assess what representations and computations models learn? How do we formalize desirable properties of interpretable models, and measure the extent to which existing models achieve them? How can we build models that better encode these properties? What can new or existing tools tell us about these systems’ inductive biases?
The goal of this workshop is to bring together researchers focused on interpreting and explaining NLP models by taking inspiration from fields such as machine learning, psychology, linguistics, and neuroscience. We hope the workshop will serve as an interdisciplinary meetup that allows for cross-collaboration.
Topics of interest include, but are not limited to:
* Applying analysis techniques from neuroscience to analyze high-dimensional vector representations in artificial neural networks;
* Analyzing the network’s response to strategically chosen input in order to infer the linguistic generalizations that the network has acquired;
* Examining network performance on simplified or formal languages;
* Mechanistic interpretability, reverse engineering approaches to understanding particular properties of neural models;
* Proposing modifications to neural architectures that increase their interpretability;
* Testing whether interpretable information can be decoded from intermediate representations;
* Explaining specific model predictions made by neural networks;
* Generating and evaluating the quality of adversarial examples in NLP;
* Developing open-source tools for analyzing neural networks in NLP;
* Evaluating the analysis results: how do we know that the analysis is valid?
*Submissions*
-----------------
We call for two types of papers:
1) *Archival papers*. These are papers reporting on completed, original and unpublished research, with a maximum length of 8 pages + references (papers shorter than this maximum are also welcome). Broader Impacts/Ethics and Limitations sections are optional and can be included on a 9th page. An optional appendix may appear after the references in the same pdf file. Accepted papers are expected to be presented at the workshop and will be published in the workshop proceedings of the ACL Anthology, meaning they cannot be published elsewhere. They should report on obtained results rather than intended work. These papers will undergo double-blind peer-review, and should thus be anonymized.
2) *Extended abstracts*. These may report on work in progress or may be cross-submissions that have already appeared (or are scheduled to appear) in another venue in 2024-2025. The extended abstracts are of a maximum of 2 pages + references. These submissions are non-archival and will not be included in the proceedings. The selection will not be based on a double-blind review and thus submissions of this type need not be anonymized.
Submissions should follow the official EMNLP 2024 style guidelines.
Accepted submissions for both tracks will be presented at the workshop: most as posters, some as oral presentations (determined by the program committee).
*The submission site is:*
https://openreview.net/group?id=EMNLP/2024/Workshop/BlackBoxNLP
*Organizers*
-----------------
Yonatan Belinkov, Technion
Najoung Kim, Boston University
Jaap Jumelet, University of Amsterdam
Hosein Mohebbi, Tilburg University
Aaron Mueller, Northeastern University & Technion
Hanjie Chen, Rice University
*Contact*
---------------------
Please contact the organizers via email (blackboxnlp@googlegroups.com) for any questions.
Read more on the workshop's website:
Dear Sender,
I am currently out of the office and will not be checking emails regularly. I will return on September 9, and will respond to your message as soon as possible after that date.
Best regards, Charlott Jakob
On 8 Aug 2024, at 17:05, Hosein Mohebbi via Corpora corpora@list.elra.info wrote:
Last Call for Papers: The seventh edition of the BlackboxNLP workshop, co-located with EMNLP 2024, in Miami on November 15, 2024. .
Important dates --------------------- August 15, 2024 - Paper submission deadline (through OpenReview). September 20, 2024 - Notification of acceptance. October 4, 2024 - Camera-ready deadline. November 15, 2024 - Workshop date.
All deadlines are 11:59PM UTC-12:00 (“Anywhere on Earth”). We will accept ARR submissions; corresponding deadlines will be announced at a later moment in time.
Workshop description: ----------------- Many recent performance improvements in NLP have come at the cost of understanding of the systems. How do we assess what representations and computations models learn? How do we formalize desirable properties of interpretable models, and measure the extent to which existing models achieve them? How can we build models that better encode these properties? What can new or existing tools tell us about these systems’ inductive biases?
The goal of this workshop is to bring together researchers focused on interpreting and explaining NLP models by taking inspiration from fields such as machine learning, psychology, linguistics, and neuroscience. We hope the workshop will serve as an interdisciplinary meetup that allows for cross-collaboration.
Topics of interest include, but are not limited to: * Applying analysis techniques from neuroscience to analyze high-dimensional vector representations in artificial neural networks; * Analyzing the network’s response to strategically chosen input in order to infer the linguistic generalizations that the network has acquired; * Examining network performance on simplified or formal languages; * Mechanistic interpretability, reverse engineering approaches to understanding particular properties of neural models; * Proposing modifications to neural architectures that increase their interpretability; * Testing whether interpretable information can be decoded from intermediate representations; * Explaining specific model predictions made by neural networks; * Generating and evaluating the quality of adversarial examples in NLP; * Developing open-source tools for analyzing neural networks in NLP; * Evaluating the analysis results: how do we know that the analysis is valid?
Submissions ----------------- We call for two types of papers: 1) Archival papers. These are papers reporting on completed, original and unpublished research, with a maximum length of 8 pages + references (papers shorter than this maximum are also welcome). Broader Impacts/Ethics and Limitations sections are optional and can be included on a 9th page. An optional appendix may appear after the references in the same pdf file. Accepted papers are expected to be presented at the workshop and will be published in the workshop proceedings of the ACL Anthology, meaning they cannot be published elsewhere. They should report on obtained results rather than intended work. These papers will undergo double-blind peer-review, and should thus be anonymized. 2) Extended abstracts. These may report on work in progress or may be cross-submissions that have already appeared (or are scheduled to appear) in another venue in 2024-2025. The extended abstracts are of a maximum of 2 pages + references. These submissions are non-archival and will not be included in the proceedings. The selection will not be based on a double-blind review and thus submissions of this type need not be anonymized.
Submissions should follow the official EMNLP 2024 style guidelines. Accepted submissions for both tracks will be presented at the workshop: most as posters, some as oral presentations (determined by the program committee).
The submission site is: https://openreview.net/group?id=EMNLP/2024/Workshop/BlackBoxNLP
Organizers ----------------- Yonatan Belinkov, Technion Najoung Kim, Boston University Jaap Jumelet, University of Amsterdam Hosein Mohebbi, Tilburg University Aaron Mueller, Northeastern University & Technion Hanjie Chen, Rice University
Contact --------------------- Please contact the organizers via email (blackboxnlp@googlegroups.com) for any questions.
Read more on the workshop's website: https://blackboxnlp.github.io
_______________________________________________ Corpora mailing list -- corpora@list.elra.info https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/ To unsubscribe send an email to corpora-leave@list.elra.info
-
Hosein Mohebbi -
Jakob, Charlott Frederike