***Call for Participation***

***First Shared Task on Multi-Perspective Scientific Document Summarization (MuP)***

Website: https://github.com/allenai/mup

Generating summaries of scientific documents is known to be a challenging task. The majority of existing work in summarization assumes only one single best gold summary for each given document. Having only one gold summary negatively impacts our ability to evaluate the quality of summarization systems, as writing summaries is a subjective activity. At the same time, annotating multiple gold summaries for scientific documents can be extremely expensive as it requires domain experts to read and understand long scientific documents. This shared task will enable exploring methods for generating multi-perspective summaries. We introduce a novel summarization corpus, leveraging data from scientific peer reviews to capture diverse perspectives from the reader's point of view (each paper has multiple summaries reflecting multiple perspectives of the reader).

The MuP shared task is a part of the 3rd Scholarly Document Processing (SDP) workshop at COLING 2022. https://sdproc.org/2022/

More details on the shared task and the corresponding dataset can be found on: https://github.com/allenai/mup

****Please fill in this form to participate in the shared task*** *

https://forms.gle/K2UECKvmghzDHUpo7

The leaderboard for the shared task will be announced soon on the website.

Shared Task Timelines

Training Data Release: May 10, 2022

Test Data Release: June 30, 2022

Evaluation Period: July 1 - July 15, 2022

System Description Papers Due: August 1, 2022

Reviews Notification: August 15, 2022

Camera-Ready Papers Due: September 5, 2022

Event at SDP @ COLING 2022: October 16/17, 2022

MuP 2022 Organizers

1.

Guy Feigenblat - Piiano, Israel 2.

Arman Cohan - AI2, US 3.

Tirthankar Ghosal - ÚFAL, Charles University, Czechia 4.

Michal Shmueli-Scheuer - IBM Research AI, Israel