Second Call for papers: MOOMIN - the first workshop on Modular and Open Multilingual NLP collocated with EACL 2024, March 21 or 22, 2024
Website: https://moomin-workshop.github.io/
Submission website: https://openreview.net/group?id=eacl.org/EACL/2024/Workshop/MOOMIN Invited speakers: Edoardo M. Pontihttps://ducdauge.github.io/ (University of Edinburgh) and Angela Fanhttps://ai.meta.com/people/angela-fan/ (Meta AI)
We invite submissions to the first edition of the MOOMIN workshop on Modular and Open Multilingual NLP, to be held at EACL 2024 on March 21 or 22, 2024.
[Important Dates]
* Workshop paper due: December 18, 2023 * Resubmission deadline (for pre-reviewed ARR & main conference submissions): January 17, 2024 * Notification of acceptance: January 20, 2024 * Camera-ready papers due: January 30 2024 * Workshop dates: March 21-22, 2024
[Introduction]
NLP in the age of monolithic large language models starts to hit the limits in terms of size and information that can be handled. The trend goes to modularization, a necessary step into the direction of designing smaller sub-networks and components with specialized functionality. This allows researchers to design scalable, wide-coverage, efficient and reusable models.
Multilingual NLP is today faced with a number of difficult challenges. Scaling a multilingual model to a high number of languages is prone to suffer from negative interference, also known as the curse of multilinguality, leading to degradation in per-language performance, while earlier approaches to improving model capacity have hit the ceiling in terms of hardware, data and training algorithms. At the same time, we as a community wish to foster the development of open components that can be shared, deployed and widely integrated within the broader research community without incurring computational costs that add to the overall carbon footprint of NLP engineering. Modularity is a practical solution to answer all of these challenges and more, as it offers a very promising set of tools towards increased multilinguality of larger foundation models, either during their pretraining or in a post-hoc post-pretraining manner.
[Topics of Interest]
With this in mind, the MOOMIN workshop invites contributions related but not limited to the following topics:
* mixture of expert models and gated routing * modular pre-training of multilingual language and translation models * effective transfer with modular architectures such as adapters and hypernetworks * efficient parallelization and distribution of modular model training * modular frameworks and architecture implementations * massively multilingual models with large language coverage * subnet selection and pruning * modular distillation * modular extensions of existing NLP models systems, especially in low-resource settings and for low-resource languages * evaluation of modular systems in terms of performance, efficiency, and computational costs * platforms for distributing, sharing, and integrating NLP components
[Submission Guidelines]
Authors are invited to submit original and unpublished research papers in the following categories:
* Full papers (up to 8 pages) for substantial contributions. * Short papers (up to 4 pages) for ongoing or preliminary work.
All submissions must be in PDF format, submitted electronically via OpenReview (https://openreview.net/group?id=eacl.org/EACL/2024/Workshop/MOOMIN) and should follow the EACL 2024 formatting guidelines (following the ARR CfPhttps://aclrollingreview.org/cfp: use the official ACL style templates, which are available herehttps://github.com/acl-org/acl-style-files).
We also intend to invite papers accepted to Findings to reach out to the organizing committee of MOOMIN to present their papers at the workshop, if in line with the topics as described above.
[Workshop Organizers]
* Timothee Mickus, University of Helsinki * Jörg Tiedemann, University of Helsinki * Ahmet Üstün, Cohere For AI * Raúl Vázquez, University of Helsinki * Ivan Vulić, University of Cambridge & PolyAI
[Program Committee]
A list of program committee members will be available on the workshop website.
[Contact] For inquiries, please contact moomin.nlp.workshop@gmail.commailto:moomin.nlp.workshop@gmail.com