The AmericasNLP 2025 Shared Task on machine translation metrics for Indigenous languages is a competition intended to motivate the advancement of automatic evaluation metrics for machine translation, with a focus on translation into Indigenous languages. Participants will build metrics to evaluate the quality of translations from Spanish into Guarani, Bribri, and Nahuatl.
Many Indigenous languages of the Americas have linguistic characteristics that are uncommon in the languages typically studied in natural language processing (NLP). For example, Indigenous languages can often be polysynthetic, and they frequently lack orthographic standardization, both of which pose challenges for, e.g., the widely used BLEU and ChrF scores. The goal of the AmericasNLP 2025 shared task on machine translation metrics for Indigenous languages is to encourage researchers to tackle the challenge of creating automatic evaluation metrics for MT systems with a focus on Indigenous languages.
Shared task description: https://turing.iimas.unam.mx/americasnlp/2025_st_3.html Registration: https://docs.google.com/forms/d/e/1FAIpQLSfmV9gyab03pGGzzDJ9DohOf9AkDaZf_94R...
AmericasNLP will be held in NAACL 2025, Albuquerque, New Mexico. The workshop date is May 4, 2025.
Thanks,
Ali, on behalf of the AmericasNLP team