- Corpora - ELRA lists

Barriers in NLP (a survey)
by Ted Pedersen 17 Oct '22

17 Oct '22

We(*) hope to better understand what barriers exist in NLP, who is being affected, and ultimately what can be done to improve the situation. The following survey is a starting point to try and address some of these questions. It is available in Bangla, Chinese, English, and Spanish, and we are certainly open to additional languages (so please be in touch). Feel free to forward this as you think appropriate, and we hope you will take a few minutes to fill out the survey. https://github.com/thamar-solorio/barriers_in_nlp Thank you! * We are : - Diyi Yang <https://scholar.google.com/citations?user=j9jhYqQAAAAJ&hl=en> - Manuel Montes <https://ccc.inaoep.mx/~mmontesg/> - Ted Pedersen <https://www.d.umn.edu/~tpederse/> - Thamar Solorio <https://github.com/thamar-solorio/barriers_in_nlp/blob/main/tsolorio.uh.edu> You are most welcome to contact any of us should you need additional information or have suggestions. --- Dr. Ted Pedersen (he/him) http://www.d.umn.edu/~tpederse UEA-A Member : https://sites.google.com/d.umn.edu/ueaumd

1 0

Job: PostDoc, Transfer learning for discourse parsing - IRIT, Toulouse (France)
by Chloé Braud 17 Oct '22

17 Oct '22

Postdoc position at IRIT, Toulouse (France) – ANR AnDiAMO Developing systems towards robust discourse parsing and its application https://pagesperso.irit.fr/~Chloe.Braud/andiamo/ * Contract duration: 12 months (flexible) * Starting date: December 2022 (flexible) * Location: IRIT, Université P. Sabatier (Toulouse III) * Remuneration: starting at 2,745 euros, gross salary, depending on experience * Application deadline: the position will be open until fulfilled * Send application by email to chloe.braud(a)irit.fr Application procedure: please send a CV and a short letter motivating your application by detailing the following elements: * indicate your **skills in machine learning**, e.g. the type of tasks you already worked on, the type of algorithms, the libraries used. Please specify your experience with neural architectures and pre-trained language models. * describe your **interest and/or experience in natural language processing**, i.e. the type of tasks you already tried to solve if any, or similar problems you worked on, or why you now want to work in NLP and why you think your experience in another domain could be relevant * If you are interested but don’t have a phd, rather a master / engineer diploma and your CV fits the requirements, please send me an email with the same information as above Incomplete application will not be considered. The AnDiAMO project: Natural Language Processing (NLP) is a domain at the frontier of AI, computer science and linguistics, aiming at developing systems able to automatically analyze textual documents. Within NLP, discourse parsing is a crucial but challenging task: its goal is to produce structures describing the relationships (e.g. explanation, contrast...) between spans of text in full documents, allowing for making inference on their content. Developing high-performing and robust discourse parsers could help to improve downstream applications such as automatic summarization or translation, question-answering, chat bots, e.g. [1,2,3]. However, current performance are still low, mainly due to the lack of annotated data (see e.g. [4] on monologues, [5] on dialogues, [6,7] for the multilingual setting). In order to develop robust discourse parsers within the AnDiAMO project, we want to explore multi-objective settings, where the goal is ultimately to perform a discourse analysis, but relying on another related objective such as performing well on another task (e.g. morphological, syntactic or temporal analysis), or an application (e.g. sentiment analysis or argument mining). We will also explore the issues of cross-language and cross framework learning. The position is funded by the ANR AnDiAMO project, for which an engineer has already been hired, master interns will also be recruited. Collaborations are planned with researchers in Toulouse, Grenoble, Nancy and Munich. The hired person will be part of the MELODI team at IRIT, participating in team and project meetings, and co-authoring articles. Research plan: The recruited candidate will work on one or several of the following topics, depending on its interests: - Data representation: Discourse processing requires information from various levels of linguistics analysis. For now, existing studies do not make it clear what kind of information is important and needed, and some potentially relevant sources of information are ignored. We plan to explore this issue within a multi-task learning setting, where a system has to jointly learn different tasks. We will experiment on classification tasks (discourse relation, segmentation) and on full discourse parsing. - Transferring to new languages, domains and modalities: Developing systems that perform well on domains or languages that are different from those used at training time is crucial, especially if the adaptation can be done in an unsupervised way. It is especially important for discourse, since annotation is very hard and time-consuming. We plan to experiment with cross-lingual embeddings and to explore multi-task learning, but trying to understand how to integrate additional linguistic information with only little annotated data for auxiliary tasks. We also want to investigate dialogues, for which only a few discourse parsers exist, and better understand how it differs from monologues. - Extrinsic evaluation: We will investigate a few downstream applications that could benefit from discourse information, as a way to give an extrinsic evaluation. We will explore pipeline systems, varying the way we encode the discourse information as input of our end system. We will also explore transfer learning strategies, either via multi-task learning or representation learning. We plan to start with cognitive impairment detection (e.g. schizophrenia, Alzheimer) and argument mining. More applications will be considered, depending on the interest of the recruited postdoc. It will be possible to investigate other paths of research, such as few-shot or unsupervised learning, depending on the interest of the recruited candidate.Profile * PhD degree in computer science or computational linguistics * Good knowledge in Machine Learning is required * Interest in language technology / NLP * Good programming skills: preferably with Python, knowledge of PyTorch is a plus References [1] Feng, X., Feng, X., Qin, B., and Geng, X. Dialogue Discourse-Aware Graph Model and Data Augmentation for Meeting Summarization. In Proceedings of IJCAI. 2019. [2] Bawden, R., Sennrich, R., Birch, A., and Haddow, B. Evaluating Discourse Phenomena in Neural Machine Translation. In Proceedings of NAACL. 2018 [3] Xu, J., Gan, Z., Cheng, Y., & Liu, J. Discourse-Aware Neural Extractive Text Summarization. In Proceedings of ACL. 2020 [4] Koto, F., Lau, J. H., & Baldwin, T. Top-down Discourse Parsing via Sequence Labelling. In Proceedings of EACL. 2021 [5] Liu, Z., & Chen, N. Improving Multi-Party Dialogue Discourse Parsing via Domain Integration. In Proceedings of the 2nd Workshop on Computational Approaches to Discourse. 2021 [6] Braud, C., Coavoux, M., & Søgaard, A. Cross-lingual RST Discourse Parsing. In Proceedings of EACL. 2017[7] Liu, Z., Shi, K., & Chen, N. DMRST: A Joint Framework for Document-Level Multilingual RST Discourse Segmentation and Parsing. In Proceedings of the 2nd Workshop on Computational Approaches to Discourse. 2021

1 0

Re: treebanks with good annotation of coordination? (any language, any syntactic schema)
by g.bouma＠rug.nl 17 Oct '22

17 Oct '22

Hi Adam, the Alpino/LassySmall corpora for Dutch may have what you need, ie it has manually verified annotation of shared conjuncts, also a bit more general (ie including adjectival modifiers for instance) than what is the rule for UD/EUD. https://www.let.rug.nl/~vannoord/Lassy/ The data can be searched here: https://paqu.let.rug.nl:8068/ ie using the Xpath search function, //node[@rel="cnj"]/node[@index] for Lassy Klein gives a good first impression of shared arguments, best, Gosse Bouma >> Le 13 oct. 2022 à 09:06, Adam Przepiórkowski via Corpora <corpora(a)list.elra.info> a écrit : >> >> Dear All, >> >> I am looking for treebanks (of any kind; dependency, constituency, LFG, HPSG, …) with good – preferably manual – unambiguous annotation of coordinate structures, for any language. >> >> A typical UD treebank does not have a good annotation of coordinations, because vanilla UD does not distinguish between dependents of single conjuncts, as in I [came and [bought a book]], and shared dependents of conjuncts, as in I [[saw and bought] a book]. Enhanced UD can in principle make this distinction, but many EUD treebanks are automatically converted from vanilla UD treebanks, so this information is also often not available or not reliable. On the other hand, many constituency treebanks (including PTB) do not have explicit information about governors of coordinations (in I bought John and Mary interesting books the governor of John and Mary is bought and not, say, books), and – perhaps surprisingly – it is often not easy to guess the governor. So I am looking for treebanks that wear both kinds of information – about shared dependents and about governors – on their sleeves. >> >> Thanks, best, >> Adam P. >> _ -- Gosse Bouma, Communication and Information Science, Groningen University, P.o. box 716, 9700 AS Groningen G.Bouma(a)rug.nl tel. +31-50-3635937

1 0

Call for Papers: The sixth workshop on Universal Dependencies (UDW 23)
by Loïc Grobol 17 Oct '22

17 Oct '22

(with apologies for cross-posting) UDW 23, WASHINGTON DC, MARCH 9-12, 2023 Universal Dependencies (UD) is a framework for cross-linguistically consistent treebank annotation that has so far been applied to over 100 languages (https://universaldependencies.org). The framework is aiming to capture similarities as well as idiosyncrasies among typologically different languages. The Universal Dependencies Workshop is a forum for discussion of the theory and practice of UD, its use in research and development, and its future goals and challenges. The five workshops so far were held at NoDaLiDa in Gothenburg (2017), at EMNLP in Brussels (2018), at SyntaxFest in Paris and Online (2019 and 2021) and at COLING online (2020). The sixth workshop on Universal Dependencies will take place during the week of March 9th-12th, 2023 in Washington D.C. on the campus of Georgetown University as part of GURT 2023. We invite papers on all topics relevant to UD, including but not limited to: - Theoretical foundations and universal guidelines - Linguistic analysis of specific languages and/or constructions - Language typology and linguistic universals - Treebank annotation, conversion and validation - Word segmentation, morphological tagging and syntactic parsing - Downstream applications in natural language processing - Linguistic studies based on the UD data Priority will be given to papers that adopt a cross-lingual perspective. VENUE The Georgetown University Round Table on Linguistics (GURT) is a peer-reviewed annual linguistics conference held continuously since 1949 at Georgetown University in Washington DC, with topics and co-located events varying from year to year. Under an overarching theme of ‘Computational and Corpus Linguistics’, GURT 2023 will feature four workshops focused on computational and corpus approaches to syntax: UDW, Depling, TLT, and CxGs+NLP. Talks will take place in plenary sessions to promote cross-fertilization of ideas across subcommunities. INVITED SPEAKER Joakim Nivre (RISE) IMPORTANT DATES - November 15, 2022: submission deadline (long and short papers) - January 11, 2023: notification of acceptance - February 1, 2023: camera-ready papers due - March 9–12, 2023: conference SUBMISSION INFORMATIONS We invite paper submissions in two distinct tracks: - Regular papers on substantial, original, and unpublished research, including empirical evaluation results, where appropriate - Short papers on smaller, focused contributions, work in progress, negative results, surveys, or opinion pieces. All papers accepted for presentation at the workshop will be included in the UDW23 proceedings volume, which will be part of the ACL Anthology. See details at https://gurt.georgetown.edu/gurt-2023/udw-call-for-papers Depending on the number of submissions, we will also accept a small number of short, non-archival communications, mainly opinion pieces and discussion on evolution to UD. Please contact the workshop chairs directly. CONTACT: Loïc Grobol (Université Paris Nanterre) Francis Tyers (Indiana University) Website: https://universaldependencies.org/udw23/ -- Loïc Grobol (they/them) MCF / Assistant Professor MoDyCo, Université Paris Nanterre Academic webpage: https://loicgrobol.github.io

2 1

treebanks with good annotation of coordination? (any language, any syntactic schema)
by Adam Przepiórkowski 16 Oct '22

16 Oct '22

Dear All, I am looking for treebanks (of any kind; dependency, constituency, LFG, HPSG, …) with good – preferably manual – unambiguous annotation of coordinate structures, for any language. A typical UD treebank does not have a good annotation of coordinations, because vanilla UD does not distinguish between dependents of single conjuncts, as in *I [came and [bought a book]]*, and shared dependents of conjuncts, as in *I [[saw and bought] a book]*. Enhanced UD can in principle make this distinction, but many EUD treebanks are automatically converted from vanilla UD treebanks, so this information is also often not available or not reliable. On the other hand, many constituency treebanks (including PTB) do not have explicit information about governors of coordinations (in *I bought John and Mary interesting books* the governor of *John and Mary* is *bought* and not, say, *books*), and – perhaps surprisingly – it is often not easy to guess the governor. So I am looking for treebanks that wear both kinds of information – about shared dependents and about governors – on their sleeves. Thanks, best, Adam P.

6 5

CFP and final deadline: PAC 2023 – Spoken English varieties: interfaces and multidimensional approaches
by Anne Przewozny desriaux 16 Oct '22

16 Oct '22

Apologies for cross-posting Dear colleagues, Please find below the final CFP for the PAC 2023 international conference entitled Spoken English varieties: interfaces and multidimensional approaches. PAC 2023 – Spoken English varieties: interfaces and multidimensional approaches International conference Wednesday, April 12th to Friday, April 14th 2023 @ Université Paris Nanterre, France Guest Speakers David Britain, University of Bern, Switzerland Alexander Haselow, University of Münster, Germany Magdalena Wrembel, Adam Mickiewicz University, Poland Best regards, Anne Przewozny-Desriaux ***************************************************************************** PAC 2023 – Spoken English varieties: interfaces and multidimensional approaches International conference Wednesday, April 12th to Friday, April 14th 2023 @ Université Paris Nanterre, France Guest Speakers David Britain, University of Bern, Switzerland Alexander Haselow, University of Münster, Germany Magdalena Wrembel, Adam Mickiewicz University, Poland Organised by CREA (Centre de Recherches Anglophones), Université Paris Nanterre TransCrit (Transferts Critiques anglophones), Université Paris 8 with the support of LPL, Aix-Marseille Université CLILLAC-ARP, Université Paris Cité CLLE, Université Toulouse Jean Jaurès The PAC programme (Phonologie de l’Anglais Contemporain: usages, variétés et structure - The Phonology of Contemporary English: usage, varieties and structure) is coordinated by Anne Przewozny-Desriaux (Toulouse Jean Jaurès University), Sophie Herment (University of Aix-Marseille), Sylvain Navarro (Paris Cité University) and Cécile Viollain (Paris Nanterre University). The main aims of the programme can be summarized as follows: to give a better picture of spoken English in its unity and diversity (geographical, social and stylistic); to test existing theoretical models in phonology, phonetics and sociolinguistics from a synchronic and diachronic point of view, making room for the systematic study of variation; to favour communication between specialists in speech and in phonological theory; and to provide corpus-based data and analyses which will help improve the teaching of English as a foreign language. To learn more about us, you can visit the programme’s website: https://www.pacprogramme.net/?lang=en. The 16th edition of the PAC international conference in 2023 will focus on interfaces between phonology and phonetics as well as other levels of linguistic structure in contemporary spoken English varieties on the basis of corpus data. Multidimensional approaches to oral corpora are understood as approaches combining different levels of linguistic analysis and/or tools and methods borrowed from other disciplines (such as sociology, geography, anthropology, computer science, stylistics, psychology, neuro and cognitive sciences, media studies, cultural studies). The conference will be organized around three days of plenary and thematic sessions focusing on the issues detailed hereafter. We will welcome submissions which address, but are not limited to, these topics. Submissions need not be limited to a single thematic session either and may encompass issues from different themes. 1. Identities, attitudes & representations The following topics and questions fall within the scope of this session: • What are the current dynamics of linguistic and cultural communities and identities in the English-speaking world? Are there new linguistic and cultural identities currently emerging? • How are these communities and identities self-perceived and represented, notably in audiovisual and/or literary productions? What is their relationship to traditional standard varieties? • What interfaces or multidimensional approaches can best tackle the issues of sociolinguistic evaluation, representation, authenticity and stereotyping? 2. Standard(s), variation & change The following topics and questions fall within the scope of this session: • What are ongoing changes in contemporary spoken varieties of English (standard and non-standard)? Do they challenge existing theoretical models of speech variation? • What is the impact of regional and social factors on variation and change in the English-speaking world? • What concepts and notions can be borrowed from other disciplines to account for variation and change? • How can corpus phonology shed light on the phonology/phonetics interface? • How do authentic data contribute to empirical approaches in phonology? 3. Suprasegmentals The following topics and questions fall within the scope of this session: • What are the suprasegmental characteristics of contemporary varieties of spoken English? • What interfaces (e.g. prosody/syntax, prosody/pragmatics) or multidimensional approaches (e.g. acoustics, kinesics) can adequately account for the suprasegmental characteristics of spoken varieties of English? • What is the impact of regional and social factors on rhythmic and intonational patterns in spoken English? • How can intonational variation be described, modeled? • What tools are most relevant for the (semi-)automatic annotation of prosody? 4. Interphonology & learner corpora The following topics and questions fall within the scope of this session: • What are the characteristics of L2 varieties of English? How can the acquisition of L2 phonology best be modeled? • How can L2 pronunciation be assessed? What are the most relevant criteria to take into account? How can multidimensional approaches to oral performance help provide feedback to learners? • What is the impact of motivation and self-efficacy on L2 speech productions and perception? • What are learners’ representations of English teaching norms and stereotypes regarding the different varieties of spoken English? 5. Oral syntax The following topics and questions fall within the scope of this session: • What is the syntax of contemporary varieties of spoken English? How can it be described? What are its unique features? • Are the tools and methods used to describe the syntax of written varieties of English appropriate/relevant for the study of spoken English syntax? What adjustments and/or developments can be advocated? • To what extent can oral syntax be studied independently from other linguistic levels of structure? What interfaces (e.g. syntax/prosody, syntax/pragmatics) may be necessary to adequately account for the syntactic characteristics of spoken varieties of English? Are all theoretical frameworks equally equipped to account for the specificities of oral syntax? What syntactic phenomena challenge existing models and frameworks? In tackling these issues, comparisons with written data / varieties are not excluded as long as the main contribution is the characterization of oral syntax. Given the exploratory nature of this topic, we will also welcome presentations reporting work in progress on those issues and technical solutions for the multidimensional study of oral syntax. Dates and deadlines Conference: April 12th to April 14th 2023 Final deadline for submissions: October 31st 2022 Results of refereeing of abstracts: December 4th 2022 Anne Przewozny-Desriaux Professeur de linguistique anglaise | Phonologie et sociolinguistique Dpt Etudes du Monde Anglophone Dir. adjointe CLLE | CNRS UMR 5263 Université Toulouse-Jean Jaurès, France https://clle.univ-tlse2.fr/accueil/annuaire/anne-przewozny-desriaux#/ https://dema.univ-tlse2.fr The Corpus Phonology of English: Multifocal Analyses of Variation https://edinburghuniversitypress.com/book-the-corpus-phonology-of-english-h… La Langue des Australiens http://www.lambert-lucas.com/la-langue-des-australiens-genese PAC programme & LVTI project https://www.pacprogramme.net/

1 0

Job: Assistant Professor, Computational Linguistics, University of Toronto Scarborough
by Ewan Dunbar 16 Oct '22

16 Oct '22

Assistant Professor - Computational Linguistics Date Posted: 10/06/2022 Closing Date: 11/17/2022, 11:59PM ET Req ID: 26528 Job Category: Faculty - Tenure Stream (continuing) Faculty/Division: University of Toronto Scarborough Department: UTSC: Department of Language Studies Campus: University of Toronto Scarborough (UTSC) Description: The Department of Language Studies at the University of Toronto Scarborough (UTSC) invites applications for a full-time tenure stream position in the area of Computational Linguistics. The appointment will be at the rank of Assistant Professor, with an expected start date of July 1, 2023, or shortly thereafter. Candidates must have earned a PhD degree in Linguistics, Computer Science, Psychology, Cognitive Science or a closely related area—with a focus on computational linguistics—by the time of appointment, or shortly thereafter, with a demonstrated record of excellence in research and teaching. We seek candidates whose research and teaching interests complement and enhance our existing departmental strengths in theoretical linguistics, psycholinguistics, and Indigenous language revitalization. The successful candidate will be expected to pursue innovative and independent research at the highest international level and to establish an outstanding, competitive, and externally funded research program. Candidates must have a strong focus on applying computational methods to questions in linguistic research, e.g., language structure, processing, production, acquisition. This focus should be clearly explained in the research statement. Research connections with natural language processing (NLP)/speech technology will be considered an asset. Applicants who do not have NLP research connections should be familiar with methods used in NLP/speech technology applications. The ideal candidate will also demonstrate an ability to teach foundational linguistics courses. Candidates must provide evidence of research excellence which can be demonstrated by a record of publications in top-ranked and field relevant journals/conference proceedings or forthcoming publications meeting high international standards, the submitted research statement, presentations at significant conferences, awards and accolades, and strong endorsements from referees of high standing. The successful candidate will also be expected to demonstrate excellence in teaching, and to contribute to curriculum development of undergraduate courses in computational linguistics. Evidence of excellence in teaching will be provided through teaching accomplishments, the teaching dossier (with required materials outlined below) submitted as part of the application, as well as strong letters of reference. The candidate will have an appointment in the tri-campus graduate department in Linguistics and will teach and supervise graduate students in that department. Candidates must also show evidence of a commitment to equity, diversity, inclusion, and to the promotion of a respectful and collegial learning and working environment, as demonstrated through the application materials. Salary will be commensurate with qualifications and experience. The Department of Language Studies is located at the University of Toronto Scarborough (UTSC), a research-intensive campus with an interdisciplinary commitment, a multicultural student body, and modern facilities. The University offers the opportunity to conduct research, teach and live in one of the most diverse cities in the world. The University also offers opportunities to work in a range of collaborative programs and centers of research. For additional information on the Department of Language Studies, please visit https://www.utsc.utoronto.ca/dls/welcome-department-language-studies; to learn more about the Graduate Department of Linguistics, please see https://www.linguistics.utoronto.ca/ All qualified candidates are invited to apply online by following the link below and clicking "Apply Now." https://jobs.utoronto.ca/job/Toronto-Assistant-Professor-Computational-Ling… Applicants must submit a cover letter, a current curriculum vitae, a research statement outlining current and future research interests, a recent writing sample, and a teaching dossier, which should include a teaching statement, sample course materials, including ideas for future teaching, and teaching evaluations. Applicants must also provide the name and contact information of three references. The University of Toronto’s recruiting tool will automatically solicit and collect letters of references from each after an application is submitted (this happens overnight). Applicants remain responsible for ensuring that references submit letters (on letterhead, dated and signed) by the closing date. Submission guidelines can be found at http://uoft.me/how-to-apply. Your CV and cover letter should be uploaded into the dedicated fields. Please combine additional application materials into one or two files in PDF/MS Word format. If you have any questions about this position, please contact Professor Juvénal Ndayiragije at dlssearchcommittee2022(a)utoronto.ca. All application materials, including reference letters, must be received by November 17, 2022. All qualified candidates are encouraged to apply; however, Canadians and permanent residents will be given priority. Diversity Statement The University of Toronto is strongly committed to diversity within its community and especially welcomes applications from racialized persons / persons of colour, women, Indigenous / Aboriginal People of North America, persons with disabilities, LGBTQ2S+ persons, and others who may contribute to the further diversification of ideas. As part of your application, you will be asked to complete a brief Diversity Survey. This survey is voluntary. Any information directly related to you is confidential and cannot be accessed by search committees or human resources staff. Results will be aggregated for institutional planning purposes. For more information, please see http://uoft.me/UP. Accessibility Statement The University strives to be an equitable and inclusive community, and proactively seeks to increase diversity among its community members. Our values regarding equity and diversity are linked with our unwavering commitment to excellence in the pursuit of our academic mission. The University is committed to the principles of the Accessibility for Ontarians with Disabilities Act (AODA). As such, we strive to make our recruitment, assessment and selection processes as accessible as possible and provide accommodations as required for applicants with disabilities. If you require any accommodations at any point during the application and hiring process, please contact uoft.careers(a)utoronto.ca.

1 0

Call for papers: 7th International Conference on Dependency Linguistics (Depling 2023)
by François Lareau 16 Oct '22

16 Oct '22

DEPLING 2023, WASHINGTON DC, MARCH 9-12, 2023 Depling (https://depling.org) is a bi-annual conference dedicated to dependency-based approaches in linguistics and natural language processing. Dependencies, directed labeled graph structures representing hierarchical relations between morphemes, words or semantic units, have now become the standard representation of syntactic resources and NLP technologies. Depling has become the central event for people discussing the linguistic significance of these structures, their theoretical and formal foundations, their processing, and their use in NLP tools. VENUE This year, Depling will be part of the Georgetown University Round Table on Linguistics (GURT, https://gurt.georgetown.edu) in Washington DC on March 9-12, 2023, together with UDW, TLT, and CxGs+NLP, in the spirit of previous SyntaxFests (https://syntaxfest.github.io). Talks will take place in plenary sessions to promote cross-fertilization of ideas across subcommunities. TOPICS OF INTEREST Depling addresses the use of dependency trees and related formal representations (such as DAGs) to represent linguistic structure. Topics of interest include but are not limited to: - The use of dependency structures in theoretical linguistics - Historical and epistemological foundations of dependency grammar - The use of dependency structures in corpus development - The use of dependency structures in lexicography - The use of dependency structures in computational linguistics - The relation between dependency-based grammar and other fields of science INVITED SPEAKER Guy Perrier, LORIA/Université de Lorraine (Emeritus) SUBMISSION DETAILS We invite paper submissions in two distinct tracks: - regular papers on substantial, original, and unpublished research, including empirical evaluation results, where appropriate; - short papers on smaller, focused contributions, work in progress, negative results, surveys, or opinion pieces. Papers must be submitted in PDF via OpenReview: https://openreview.net/group?id=georgetown.edu/GURT/2023/Conference Regular papers may consist of up to 8 pages (excluding references and appendices). Short papers may consist of up to 4 pages (excluding references and appendices). Accepted papers will be given an additional page to address reviewer comments. Papers should describe original work; they should emphasize completed work and should indicate clearly the state of completion of the reported results. Submissions will be judged on correctness, originality, technical strength, significance and relevance to the conference. All submissions should follow the two-column format and the ACL style. https://github.com/acl-org/acl-style-files Proceedings will be published in the ACL Anthology and will include both long and short papers. For more information, read our detailed call for papers here: https://gurt.georgetown.edu/gurt-2023/depling-call-for-papers/ IMPORTANT DATES - November 15, 2022: submission deadline (long and short papers) - January 11, 2023: notification of acceptance - February 1, 2023: camera-ready papers due - March 9–12, 2023: conference DEPLING CHAIRS François Lareau, Université de Montréal Owen Rambow, Stony Brook University Contact: depling2023(a)depling.org

1 0

Query: Guide or advice for crowd-sourcing linguistic annotations
by Robert Fuchs 14 Oct '22

14 Oct '22

Dear all I'm looking for a guide or advice for crowd-sourcing linguistic annotations via platforms such as Mechanical Turk. I'm thinking of rating tasks such as evaluating positive and negative sentiment in sentences or annotating concordances from a corpus for a certain property (e.g. deontic v epistemic meaning in modal verbs). Specifically, I'm wondering - How can I ensure that the annotations are of sufficient quality? I don't have a gold standard for all the data, after all this is why I need the annotations. If I get all the data annotated by two or three independent annotators, I can ensure adequate quality. But then I might still get annotators who more or less submit random annotations (or start doing so after a while), or at least it would take me very long to find out who is doing so. - How do I find out what remuneration is adequate? - What is a good way to split up the data for annotation? Single annotation units or, say, 50 or 100 at a time? How do I deliver them effectively to the annotators? Many thanks and best wishes Robert -- Prof. Dr. Robert Fuchs (JP) | Department of English Language and Literature/Institut für Anglistik und Amerikanistik | University of Hamburg | Überseering 35, 22297 Hamburg, Germany | Room 07076 | https://uni-hamburg.academia.edu/RobertFuchs | https://sites.google.com/view/rflinguistics/ Mailing list on varieties of English/World Englishes/ENL-ESL-EFL. Subscribe here: https://groups.google.com/forum/#!forum/var-eng/join Are you a non-native speaker of English? Please help us by taking this short survey on when and how you use the English language: https://lamapoll.de/englishusageofnonnativespeakers-1/

8 7

ACL 2023: Call for Papers
by Devamanyu Hazarika 14 Oct '22

14 Oct '22

(apologies for cross posting) ============================ ACL 2023 Website: https://2023.aclweb.org/ Submission Deadline: - ARR: 15 December 2022 - START Direct: 13 January 2023 (Abstract), 20 January 2023 (Paper) Conference Dates: July 9-14 2023 Location: Toronto, Canada Theme: Reality Check Contact: - Yang Liu (General Chair) - Jordan Lee Boyd-Graber, Naoaki Okazaki, Anna Rogers (Program Chairs): acl2023-pc(a)googlegroups.com ============================ Call for Main Conference Papers ACL 2023 invites the submission of long and short papers featuring substantial, original, and unpublished research in all aspects of Computational Linguistics and Natural Language Processing. As in recent years, some of the presentations at the conference will be of papers accepted by the Transactions of the ACL (TACL) and by the Computational Linguistics (CL) journals. === Important Dates === - Submission template available: November 1, 2022 - Anonymity period for ARR papers: November 15, 2022 - Submission deadline for papers submitted to ARR: December 15, 2022 - Anonymity period for papers submitted through START: December 20, 2022 - Abstract deadline for START direct submissions: January 13, 2023 - Direct paper submission deadline: January 20, 2023 - Commitment deadline for ARR papers: March 17, 2023 - Author response period: March 17-24, 2023 - Notification of acceptance: May 1, 2023 - Withdrawal deadline: May 8, 2023 - Camera-ready papers due: May 22, 2023 - Tutorials: July 9, 2023 - Conference: July 10-12, 2023 - Workshops: July 13-14, 2023 All deadlines are 11:59PM UTC-12:00 (“anywhere on Earth”). === Submission Topics === ACL 2023 aims to have a broad technical program. Relevant topics for the conference include, but are not limited to, the following areas (in alphabetical order): - Computational Social Science and Cultural Analytics - Dialogue and Interactive Systems - Discourse and Pragmatics - Ethics and NLP - Generation - Information Extraction - Information Retrieval and Text Mining - Interpretability and Analysis of Models for NLP - Language Grounding to Vision, Robotics and Beyond - Multilingualism and Language Contact: Code-switching, Representation Learning, Cross-lingual transfer - Linguistic Theories, Cognitive Modeling, and Psycholinguistics - Machine Learning for NLP - Machine Translation - NLP Applications - Phonology, Morphology, and Word Segmentation - Question Answering - Resources and Evaluation - Semantics: Lexical - Semantics: Sentence-level Semantics, Textual Inference, and Other Areas - Sentiment Analysis, Stylistic Analysis, and Argument Mining - Speech and Multimodality - Summarization - Syntax: Tagging, Chunking and Parsing === Theme Track: Reality Check === Following the success of the ACL 2020-2022 Theme tracks, we are happy to announce that ACL 2023 will have a new theme with the goal of reflecting and stimulating discussion about the current state of development of the field of NLP. While the current systems perform much better and fail more gracefully than their rule-based predecessors, there are growing piles of evidence of other kinds of brittleness, including out-of-domain generalization, adversarial attacks, spurious patterns (both linguistic and social), lack of sensitivity to basic linguistic perturbations such as negation, over-sensitivity to perturbations that should not matter (e.g. order and wording of prompts), etc. The theme track invites empirical and theoretical research, as well position and survey papers reflecting on the ways in which reported performance improvements on NLP benchmarks are meaningful. The possible topics of discussion include (but are not limited to) the following: - How reliably do the leaderboard scores translate to improvements in real-world use of the models? - How reliably do the leaderboard scores compare competing models? - While the current NLP systems are not brittle in the same way as their predecessors, they are still brittle in other ways. What tasks can we claim to have “solved”, if any? - Have performance improvements been accompanied by commensurate growth in the scientific understanding (of language, cognition, or deep learning technology)? In what ways? - Given that the authors of engineering papers are incentivized to report only the most successful results, especially for the systems that are also commercial products, what can the NLP venues do to improve reporting? The theme track submissions can be either long or short. We anticipate having a special session for this theme at the conference and a Thematic Paper Award in addition to other categories of awards. Visit https://2023.aclweb.org/calls/main_conference/ for more details!

1 0

2026

2025

2024

2023

2022

Corpora