- Corpora - ELRA lists

Fwd: Shared Task On Propaganda And Disinformation Detection In Arabic (co-located with EMNLP 2023)
by Firoj Alam 12 Jul '23

12 Jul '23

Dear colleagues, You are invited to participate ArAIEval shared task on (i) persuasion technique, and (ii) disinformation detection, in Arabic, which will held with the First Arabic Natural Language Processing Conference (WANLP 2023) co-located this with the EMNLP2023 Conference in Singapore (6-10 Dec, 2023). You can find detailed information here: https://araieval.gitlab.io/. Tasks Task 1: Persuasion Technique Detection: Given a multigenre (tweet and news paragraph) text snippet, identify whether it contains content with persuasion technique in a binary or multilabel classification settings. Task 2: Disinformation Detection Definition: Given only the “text” of a tweet, classify binary and/or fine-grained disinformation categories. Website: https://araieval.gitlab.io/ Dataset and relevant scripts: The datasets are hosted on the Gitlab repository: https://gitlab.com/araieval/wanlp2023_araieval/ Important Dates 13 July 2023: Started registration on codalab and beginning of the development cycle 12 August 2023: Beginning of the evaluation cycle (test sets release and run submission) 15 August 2023 23:59 AOE: End of the evaluation cycle (run submission) 29 August 2023: Deadline for the submission of working notes 12 October 2023: Notification of acceptance of working notes 20 October 2023: Deadline for submission of camera-ready working notes 7 December 2023: WANLP Conference (colocated with EMNLP-2023) Organizers - Firoj Alam, Qatar Computing Research Institute, HBKU - Hamdy Mubarak, Qatar Computing Research Institute, HBKU - Maram Hasanain, Qatar Computing Research Institute, HBKU - Samir Abdaljalil, Qatar Computing Research Institute, HBKU - Wajdi Zaghouani, HBKU - Preslav Nakov, Mohamed bin Zayed University of Artificial Intelligence - Giovanni Da San Martino, University of Padova - Abdelhakim Freihat, University of Trento The ArAiEval shared task organizers -- You received this message because you are subscribed to the Google Groups "SIGLEX members" group. To unsubscribe from this group and stop receiving emails from it, send an email to siglex-members+unsubscribe(a)googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/siglex-members/cdd368d7-c8c1-401a-825c-a3… <https://groups.google.com/d/msgid/siglex-members/cdd368d7-c8c1-401a-825c-a3…> . For more options, visit https://groups.google.com/d/optout.

1 0

10th International Conference on Behavioural and Social Computing (BESC 2023): Final Call for Papers
by georgeangelos60＠gmail.com 12 Jul '23

12 Jul '23

*** Final Call for Papers *** 10th International Conference on Behavioural and Social Computing (BESC 2023) October 30 - November 1, 2023, 5* Golden Bay Beach Hotel, Larnaca, Cyprus http://besc-conf.org/2023/ (*** Submission Deadline: 29 July, 2023 AoE ***) The International Conference on Behavioural and Social Computing (BESC) is a major international forum that brings together academic researchers and industry practitioners from artificial intelligence, computational social sciences, natural language processing, business and marketing, and behavioural and psychological sciences to present updated research efforts and progresses on foundational and emerging interdisciplinary topics of BESC, exchange new ideas and identify future research directions. The BESC series of conferences are technically sponsored by IEEE SMC (Systems, Man and Cybernetics) Society as well as IEEE CIS (Computational Intelligence Society) and the proceedings are published by IEEE BESC 2023 invites submissions of original, high-quality research papers addressing cutting-edge developments from all areas of behavioural and social computing. The conference aims to bring together researchers and practitioners from academia and industry to share their knowledge, experience, and perspectives on the latest trends, challenges, and opportunities in this rapidly evolving field. Topics of interest include, but are not limited to: Social Computing, Computational Social Science and Applications • Computational models of social phenomena • Social behaviour • Social network analysis • Semantic web • Collective intelligence • Security, privacy, trust in social contexts • Social recommendation • Social influence and social contagions • Quantifying offline phenomena through online data • Forecasting of social phenomena • Science and technology studies approaches to computational social science • Social media and health behaviours • Social psychology and personality • New theories, methods, and objectives in computational social science Digital Humanities • Digital media • Digital humanities • Digital games and learning • Digital footprints and privacy • Crowd dynamics • Digital arts • Digital healthcare • Activity streams and experience design • Virtual communities (e.g., open-source, multiplayer gaming, etc.) Information Management and Information Systems (IS) • Decision analytics • E-Business • Decision analytics • Computational finance • Societal impacts of IS • Human behaviour and IS • IS in healthcare • IS security and privacy • IS strategy, structure and organizational impacts • Service science and IS Natural Language Processing • Web mining and its social interpretations • Sentiment Analysis, Stylistic Analysis, and Argument Mining • Opinion mining and social media analytics • Credibility of online content • Computational Linguistics • Mining big social data • Cognitive Modelling and Psycholinguistics Behaviour and User Modelling, Privacy, and Ethics • Behaviour change • Positive technology • Personalization for individuals, groups and populations • Large scale personalization, adaptation and recommendation • Web dynamics and personalization • Privacy, perceived security and trust • Technology and Wellbeing • Ethics of computational research on human behaviour Technology Enhanced Learning (TEL) • E-Learning and M-Learning • Open and Distance Learning • User modeling and personalization in TEL • TEL in secondary and in higher education • New tools for TEL BESC 2023 will also host the following Special Sessions. Papers accepted in any of the Special Sessions will be included in the same IEEE conference proceedings with the papers accepted for the general technical program. ● Computational Social Psychology in Post Covid-19 Period ● Artificial Intelligence for Mental Health, Mental Illness, Psychiatic Diagnosis, and Prediction ● Intelligent E-Learning at Post Covid-19 Era ● Big Data and AI-Powered Decision Support Systems in Business ● Understanding the Citizen's Behavior in Cognitive Cities ● Nudges and Behavioural Computing Models for a Sustainable and Equitable Development SUBMISSION INSTRUCTIONS The paper submission system is using Easy Chair and the submission link is: https://easychair.org/conferences/?conf=besc2023 . All papers will be reviewed by the Program Committee on the basis of technical quality, relevance to BESC 2023, originality, significance and clarity. Please note: • All submissions should use IEEE two-column style. Templates are available here: https://www.ieee.org/conferences/publishing/templates.html • All papers must be submitted electronically through the paper submission system in PDF format only. BESC 2023 accepts research papers (6 pages), special session papers (6 pages) and Doctoral Symposium papers (4 pages). • The page count above excludes the references (but includes any appendices). • Paper review will be double-blind, and submissions not properly anonymized will be desk-rejected without review. • Submitted papers must not substantially overlap with papers that have been published or that are simultaneously submitted to a journal or a conference with proceedings. • Papers must be clearly submitted in English and will be selected based on their originality, timeliness, significance, relevance, and clarity of presentation. • Submission of a paper should be regarded as a commitment that, should the paper be accepted, at least one of the authors will register and attend the conference to present the work. • The use of artificial intelligence (AI)–generated text in an article shall be disclosed in the acknowledgements section of any paper submitted to an IEEE Conference or Periodical. The sections of the paper that use AI-generated text shall have a citation to the AI system used to generate the text. • All accepted papers will be included in IEEE Xplore and indexed by EI. Top quality papers after presented in the conference will be selected for extension and publication in several special issues of international journals, e.g., World Wide Web Journal (Springer), Web Intelligence (IOS Press), and Social Network Analysis and Mining (Springer), Human-Centric Intelligent Systems (Springer), Information Discovery and Delivery (Emerald Publishing). IMPORTANT DATES • Submission of all papers: 29 July 2023 AoE (*** extended ***) • Notification of acceptance for submitted papers: 15 September 2023 • Camera-Ready Submission: 1 October 2023 • Author Registration: 1 October 2023 ORGANISATION Steering Committee Chair • Guandong Xu, University of Technology Sydney, Australia General Chair • George A. Papadopoulos, University of Cyprus, Cyprus Program Chairs • Georgia Kapitsaki, University of Cyprus, Cyprus • Ji Zhang, University of Southern Queensland, Australia Special Session Chairs • Taotao Cai, University of Southern Queensland, Australia • Ting Yu, Zhejiang Lab, China Doctoral Symposium Chair • Barbara Caci, University of Palermo, Italy Panel and Tutorial Chair • Philippe Fournier-Viger, Shenzhen University, China Proceedings Chair • Md Rafiqul Islam, University of Technology Sydney, Australia Publicity Chairs • Chandan Gautam, Institute for Infocomm Research (I2R), A*STAR, Singapore • Thanveer Shaik, University of Southern Queensland, Australia • Sanjay Sonbhadra, ITER, Siksha 'O' Anusandhan, India Webmaster • Shiqing Wu, University of Technology Sydney, Australia

1 0

Final call for papers: 3rd Workshop on Human Evaluation of NLP Systems
by Maja Popovic 11 Jul '23

11 Jul '23

Third Workshop on Human Evaluation of NLP Systems (HumEval’23) ############################################################### https://humeval.github.io/ RANLP’23, Varna, Bulgaria, 7 September 2023 submission deadline: 20 July 2023, 23:59 UTC-12 Final Call for Papers ++++++++++++++++++++++ The Third Workshop on Human Evaluation of NLP Systems (HumEval’23) invites the submission of long and short papers on substantial, original, and unpublished research on all aspects of human evaluation of NLP systems with a focus on NLP systems which produce language as output. We welcome work on any quality criteria relevant to NLP, on both intrinsic evaluation (which assesses systems and outputs directly) and extrinsic evaluation (which assesses systems and outputs indirectly in terms of its impact on an external task or system), on quantitative as well as qualitative methods, score-based (discrete or continuous scores) as well as annotation-based (marking, highlighting). Important dates ---------------- Workshop paper submission deadline: 20 July 2023 Workshop paper acceptance notification: 5 August 2023 Workshop paper camera-ready versions: 25 August 2023 Workshop camera-ready proceedings ready: 31 August 2023 All deadlines are 23:59 UTC-12. Topics ------- We invite papers on topics including, but not limited to, the following: Experimental design and methods for human evaluations Reproducibility of human evaluations Work on inter-evaluator and intra-evaluator agreement Ethical considerations in human evaluation of computational systems Quality assurance for human evaluation Crowdsourcing for human evaluation Issues in meta-evaluation of automatic metrics by correlation with human evaluations Alternative forms of meta-evaluation and validation of human evaluations Comparability of different human evaluations Methods for assessing the quality and the reliability of human evaluations Role of human evaluation in the context of Responsible and Accountable AI We welcome work from any subfield of NLP (and ML/AI more generally), with a particular focus on evaluation of systems that produce language as output. ReproNLP shared task --------------------- The workshop will also host a shared Task on Reproducibility of Evaluations in NLP (ReproNLP). Papers ------ Long papers - - - - - - Long papers must describe substantial, original, completed and unpublished work. Wherever appropriate, concrete evaluation and analysis should be included. Long papers may consist of up to eight (8) pages of content, plus unlimited pages of references. Final versions of long papers will be given one additional page of content (up to 9 pages) so that reviewers’ comments can be taken into account. Long papers will be presented orally or as posters as determined by the programme committee. Decisions as to which papers will be presented orally and which as posters will be based on the nature rather than the quality of the work. There will be no distinction in the proceedings between long papers presented orally and as posters. Short papers - - - - - - - Short paper submissions must describe original and unpublished work. Short papers should have a point that can be made in a few pages. Examples of short papers are a focused contribution, a negative result, an opinion piece, an interesting application nugget, a small set of interesting results. Short papers may consist of up to four (4) pages of content, plus unlimited pages of references. Final versions of short papers will be given one additional page of content (up to 5 pages) so that reviewers’ comments can be taken into account. Short papers will be presented orally or as posters as determined by the programme committee. While short papers will be distinguished from long papers in the proceedings, there will be no distinction in the proceedings between short papers presented orally and as posters. Multiple submission policyPermalink HumEval’23 allows multiple submissions. However, if a submission has already been, or is planned to be, submitted to another event, this must be clearly stated in the submission form. Submission procedure and templates ----------------------------------- To submit, go directly to the workshop page at the Softconf START system https://softconf.com/ranlp23/HumEval/ The papers should follow the format of the main conference, described at the RANLP website, Submissions page. http://ranlp.org/ranlp2023/index.php/submissions/ Organisers Anya Belz, ADAPT Centre, Dublin City University, Ireland Maja Popović, ADAPT Centre, Dublin City University, Ireland Ehud Reiter, University of Aberdeen, UK João Sedoc, New-York University Craig Thomson, University of Aberdeen, UK For questions and comments regarding the workshop please contact the organisers at humeval.ws(a)gmail.com.

1 0

CfP Corpus Phonology Workshop bei BICLCE 2024
by philipp.meer＠uni-muenster.de 11 Jul '23

11 Jul '23

Dear all, On behalf of Ulrike Gut and myself, I would like to forward you a CfP for a thematic workshop on "Corpus Phonology: Current Approaches and Future Directions" (see below), which we are organizing at the BICLCE Conference 2024 in Alicante, Spain (https://web.ua.es/es/biclce2024/presentacion.html). The workshop has already been accepted. Please feel free to forward the CfP to anyone who you think might be interested in contributing to the workshop. ********** Thematic workshop: Corpus Phonology: Current Approaches and Future Directions 10th Biennial International Conference on the Linguistics of Contemporary English (BICLCE) Organizer(s): Philipp Meer (University of Münster, philipp.meer(a)uni-muenster.de); Ulrike Gut (University of Münster, gut(a)uni-muenster.de) Important dates: August 27, 2023 Deadline proposed title December 15, 2023 Deadline abstract September 26-28, 2024 Conference dates Description: We invite submissions for a workshop on "Corpus Phonology: Current Approaches and Future Directions" to be held at the 10th Biennial International Conference on the Linguistics of Contemporary English (BICLCE) in Alicante, Spain (September 26-28, 2024). The workshop aims to bring together researchers from various fields of English linguistics to share their research and discuss the latest developments in corpus phonology. Corpus phonology refers to the study of phonetic and phonological phenomena in naturally occurring speech data using corpus-based approaches (Gut 2009; Durand et al. 2014; Gut & Fuchs 2017; Liberman 2019). The field combines methods and approaches from corpus linguistics, phonetics and phonology, speech processing technology, statistics, and related fields. With the increasing availability of large-scale corpora and advances in computational tools, corpus phonology has become an important area of research in English phonetics and phonology (e.g. Rosenfelder et al. 2014; McAuliffe et al. 2017; Jansen & Langstrof 2019; Stuart-Smith et al. 2019; Meer 2020; Gorisch et al. 2020; Meer 2020; Meer et al. 2021; Li et al. 2021; Coto-Solano 2022; Coats 2023). At the same time, new types of questions and challenges for research arise. In this workshop, we aim to explore both current approaches and future directions in corpus phonology. Specifically, the workshop aims to address the following research questions: (1) How can large-scale speech corpora be effectively compiled? (2) How can large-scale speech corpora be effectively used to investigate phonetic and phonological properties of English? (3) How can corpus phonology contribute to our understanding of sociolinguistic phenomena, such as language change and contact? (4) What are the benefits and challenges in using state-of-the art computational tools in corpus phonology research, and what new research opportunities do they create? Topics of interest include, but are not limited to: • Corpus-based study of phonological variation • Corpus phonology and phonological theory • Phonological corpus compilation and computational tools (such as automatic speech recognition (ASR), forced alignment, machine learning, etc.) • The use of corpora in analyzing phonetic detail • Corpus phonology and sociolinguistics • Corpus phonology and L2/L3 research • Corpus-based approaches to prosody and intonation We welcome submissions from both established academics and early career researchers working on these and related topics. We encourage submissions that draw on data from a wide range of varieties of English, as well as those that present novel methodologies or theoretical frameworks. We would be grateful if you could confirm your willingness to contribute – together with a proposed title – by August 27, 2023. Abstract submissions should be in the form of abstracts of no more than 500 words, excluding references. Abstracts should be submitted as a PDF to the workshop organizers at philipp.meer(a)uni-muenster.de and gut(a)uni-muenster.de by December 15, 2023. Accepted abstracts will be allotted 20-minute presentation slots, followed by 10 minutes for questions and discussion. We will also allocate time for a general discussion of the research questions at the end of the workshop. The publication of an edited volume of papers presented as part of the workshop is envisaged. We look forward to receiving your submissions and to an exciting workshop on "Corpus Phonology: Current Approaches and Future Directions". Keywords: corpus phonology; corpus linguistics; speech technology; sociolinguistics; L2 research ********** Best wishes, Philipp __________ Philipp Meer Research Associate (Postdoc) University of Münster – English Department Johannisstr. 12-20, D-48143 Münster, Germany Email: philipp.meer(a)uni-muenster.de Website: https://www.uni-muenster.de/Anglistik/Staff/Meer.shtml Visiting Researcher Speech Prosody Studies Group University of Campinas (UNICAMP) – Institute of Language Studies (IEL) Rua Sérgio Buarque de Holanda, no 571, Campinas – São Paulo - Brazil External profiles: ResearchGate: https://www.researchgate.net/profile/Philipp_Meer Academia.edu: https://uni-muenster.academia.edu/PhilippMeer

1 0

2nd CfP: 4th International Workshop on Computational Approaches to Historical Language Change 2023 (LChange’23)
by Andrey Kutuzov 10 Jul '23

10 Jul '23

Dear all, We are happy to remind that there will be a full-day workshop on computational approaches to historical language change (LChange’23) co-located with EMNLP (December 6-10, 2023). The Second Call for Papers is below. The main updates compared to the 1st CfP are: 1. The submission page is now up and running at https://openreview.net/group?id=EMNLP/2023/Workshop/LChange 2. To encourage resource sharing at the reviewing phase, model and dataset papers do not need to be anonymous. The reviewing for the papers of this type will thus be single-blind. ======================================== 4th International Workshop on Computational Approaches to Historical Language Change 2023 (LChange’23) ======================================== Website: https://www.changeiskey.org/event/2023-emnlp-lchange/ Date: Dec 6, 2023 Location: Singapore and online Contact email: lchange2023(a)changeiskey.org LChange'23 is the fourth workshop for computational approaches to historical language change with the focus on digital text corpora. Come join us for this exciting adventure! The workshop builds upon its first iteration in 2019 (https://languagechange.org/events/2019-acl-lcworkshop/), and the subsequent events (2021, 2022). LChange'19 resulted in a book on Computational approaches to semantic change (https://langsci-press.org/catalog/book/303). This year, LChange will be colocated with EMNLP 2023 in Singapore, as a hybrid event. The workshop will take place on Wednesday 6 December 2023. The main topic of the workshop remains the same: all aspects around computational approaches to historical language change with the focus on digital text corpora. We hope to make this fourth edition another resounding success! ==Important Dates== September 1, 2023: Paper submission October 6, 2023: Notification of acceptance October 18, 2023: Camera-ready papers due December 6, 2023: Workshop date ==Workshop Topics== This workshop explores state-of-the-art computational methodologies, theories and digital text resources on exploring the time-varying nature of human language. The aim of this workshop is three-fold. First, we want to provide pioneering researchers who work on computational methods, evaluation, and large-scale modelling of language change an outlet for disseminating cutting-edge research on topics concerning language change. We want to utilize this workshop as a platform for sharing state-of-the-art research progress in this fundamental domain of natural language research. Second, in doing so we want to bring together domain experts across disciplines by connecting researchers in historical linguistics with those that develop and test computational methods for detecting semantic change and laws of semantic change; and those that need knowledge (of the occurrence and shape) of language change, for example, in digital humanities and computational social sciences where text mining is applied to diachronic corpora subject to e.g., lexical semantic change. Third, the detection and modelling of language change using diachronic text and text mining raise fundamental theoretical and methodological challenges for future research. Besides these goals, this workshop will also support discussion on the evaluation of computational methodologies for uncovering language change. SemEval2020 Task 1 on unsupervised detection of lexical semantic change attracted three figure submission numbers and a total of 21 submitted system papers. Since then, three more tasks have been completed in Italian, Russian, and Spanish. We invite original research papers from a wide range of topics, including but not limited to: - Novel methods for detecting diachronic semantic change and lexical replacement - Automatic discovery and quantitative evaluation of laws of language change - Computational theories and generative models of language change - Sense-aware (semantic) change analysis - Diachronic word sense disambiguation - Novel methods for diachronic analysis of low-resource languages - Novel methods for diachronic linguistic data visualization - Novel applications and implications of language change detection - Quantification of sociocultural influences on language change - Cross-linguistic, phylogenetic, and developmental approaches to language change - Novel datasets for cross-linguistic and diachronic analyses of language ==Keynote Talks== To be announced. If you have any good suggestions, or anyone you would like to listen to, please contact us. ==Submissions== URL for submissions: https://openreview.net/group?id=EMNLP/2023/Workshop/LChange. We accept two types of submissions, long and short papers, following the EMNLP 2023 style (you can also directly use the Overleaf template), and the ACL submission policy: * https://2023.emnlp.org/calls/style-and-formatting/ * https://www.overleaf.com/latex/templates/instructions-for-emnlp-2023-procee… * https://www.aclweb.org/adminwiki/index.php?title=ACL_Policies_for_Submissio… Long and short papers may consist of up to eight (8) and four (4) pages of content, respectively, plus unlimited references; final versions will be given one additional page of content so that reviewers' comments can be taken into account. LChange’23 also welcomes papers focusing on releasing a dataset or a model; these papers fall into the short paper category. To encourage resource sharing at the reviewing phase, model and dataset papers do not need to be anonymous. Accepted papers will be presented orally or as posters and included in the workshop proceedings. Submissions are open to all, and are to be submitted anonymously. All papers will be refereed through a double-blind peer review process by at least three reviewers with final acceptance decisions made by the workshop organizers. ==Contact== Contact us if you have any questions: lchange2023(a)changeiskey.org Organizers: Nina Tahmasebi, Syrielle Montariol, Haim Dubossarsky, Andrey Kutuzov, Simon Hengchen, David Alfter, Francesco Periti, and Pierluigi Cassotti. If you have published in the field previously, and are interested in helping out in the PC to review papers, send us an email. ==Anti-Harassment Policy== Our workshop highly values the open exchange of ideas, the freedom of thought and expression, and respectful scientific debate. We support and uphold the ACL Anti-Harassment policy (https://www.aclweb.org/adminwiki/index.php?title=Anti-Harassment_Policy), and any workshop participant should feel free to contact any of the workshop organizers or acl(a)aclweb.org, in case of any issues. -- Andrey Language Technology Group (LTG) University of Oslo

1 0

Second Call for Papers: GenBench, the first workshop on generalisation (benchmarking) in NLP
by Verna Dankers 10 Jul '23

10 Jul '23

*Call for Papers: GenBench, the first workshop on generalisation (benchmarking) in NLP* ****New: the Collaborative Benchmarking Task submissions are now open; visit * *https://github.com/GenBench/genbench_cbt <https://github.com/GenBench/genbench_cbt>.With the support of our workshop sponsor Amazon, we are now offering scholarships for travel expenses.**** Workshop description The ability to generalise well is often mentioned as one of the primary desiderata for models of natural language processing. It is crucial to ensure that models behave robustly, reliably and fairly when making predictions about data that is different from the data that they were trained on. Generalisation is also important when NLP models are considered from a cognitive perspective, as models of human language. Yet, there are still many open questions related to what it means for an NLP model to generalise well and how generalisation should be evaluated. The first GenBench workshop aims to serve as a cornerstone to catalyse research on generalisation in the NLP community. In particular, the workshop aims to: - Bring together different expert communities to discuss challenging questions relating to generalisation in NLP; - Crowd-source a collaborative generalisation benchmark hosted on a platform for democratic state-of-the-art (SOTA) generalisation testing in NLP. The first GenBench workshop on generalisation (benchmarking) in NLP will be co-located with EMNLP 2023. Submission types We call for two types of submissions: regular workshop submissions and collaborative benchmarking task submissions. The latter will consist of a data/task artefact and a companion paper motivating and evaluating the submission. In both cases, we accept archival papers and extended abstracts. 1. Regular workshop submissions Regular workshop submissions present papers on the topic of generalisation (see examples listed below) but are not intended to be included on the GenBench evaluation platform. Regular workshop papers may be submitted as an archival paper when they report on completed, original and unpublished research; or as a shorter extended abstract. More details on this category can be found below. Topics of interest include, but are not limited to: - Opinion or position papers about generalisation and how it should be evaluated; - Analyses of how existing or new models generalise; - Empirical studies that propose new paradigms to evaluate generalisation; - Meta-analyses that investigate how results from different generalisation studies compare to one another; - Meta-analyses that study how different types of generalisation are related; - Papers that discuss how generalisation of LLMs can be evaluated without access to training data; - Papers that discuss why generalisation is (not) important in the era of LLMs; - Studies on the relationship between generalisation and fairness or robustness. If you are unsure whether a specific topic is well-suited for submission, feel free to reach out to the organisers of the workshop at genbench(a)googlegroups.com. 2. Collaborative Benchmarking Task submissions Collaborative benchmarking task submissions consist of a data/task artefact and a paper describing and motivating the submission and showcasing it on a select number of models. We accept submissions that introduce new datasets, resplits of existing datasets along particular dimensions, or in-context learning tasks, with the goal of measuring generalisation of NLP models. We especially encourage submissions that focus on: - Generalisation in the context of fairness and inclusivity; - Multilingual generalisation; - Generalisation in LLMs, where we have no control over the training data. Each submission should contain information about the data (URIs, format, preprocessing), model preparation (finetuning loss, ICL prompt templates), and evaluation metrics. These will be defined either in a configuration file or in code. More details about the collaborative benchmarking task submissions and example submissions can be found on our website: visit genbench.org/cbt for more information or github.com/GenBench/genbench_cbt to prepare your submission. Note that there is a sample data submission deadline (August 1) in addition to the final submission deadline (September 1). Participants proposing previously unpublished datasets or splits may choose to submit an archival paper or an extended abstract. Generalisation evaluation datasets that have already been published elsewhere (or will be published at EMNLP 2023) can be submitted to the platform, as well, but only through an extended abstract, citing the original publication. We allow dual submissions with EMNLP. For more information, see below. If you are in doubt about whether a particular type of dataset is suitable for submission, please consult the information page on our website, or reach out to the organisers of the workshop at genbench(a)googlegroups.com. Archival vs extended abstract Archival papers are up to 8 pages excluding references and report on completed, original and unpublished research. They follow the requirements of regular EMNLP 2023 submissions. Accepted papers will be published in the workshop proceedings and are expected to be presented at the workshop. The papers will undergo double-blind peer review and should thus be anonymised. Extended abstracts can be up to 2 pages excluding references and may report on work in progress or be cross-submissions of work that has already appeared in another venue. Abstract titles will be posted on the workshop website but will not be included in the proceedings. Submission instructions For both archival papers and extended abstracts, we refer to the EMNLP 2023 website for paper templates. Additional requirements for both regular workshop papers and collaborative benchmarking task submissions can be found on our website. All papers can be submitted through OpenReview: https://openreview.net/group?id=GenBench.org/2023/Workshop. Collaborative Benchmarking Task submissions can be made via https://github.com/GenBench/genbench_cbt. We also accept regular workshop submissions (papers of category 1) through the ACL Rolling Review system. Authors that have their ARR reviews ready may submit their papers and reviews for consideration to the workshop. Important dates - August 1, 2023 – Sample data submission deadline - September 1, 2023 – Paper submission deadline - September 15, 2023 – ARR submission deadline - October 6, 2023 – Notification deadline - October 18, 2023 – Camera-ready deadline - December 6, 2023 – Workshop Note: all deadlines are 11:59 PM UTC-12:00 Dual submissions We allow dual submissions with EMNLP and encourage relevant papers that were dual-submitted and accepted at EMNLP to redirect to a non-archival extended abstract submission. We furthermore welcome submissions of extended abstracts that describe work already presented at an earlier venue, both in the collaborative benchmarking task and in the regular submission track. Preprints We do not have an anonymity deadline. Preprints are allowed, both before the submission deadline as well as after. Scholarships With the support of our workshop sponsor Amazon, we are offering 6 scholarships each covering up to $500 of travel expenses and/or (virtual) registration fees. Please check out our website for more information about the application process. Contact Email address: genbench(a)googlegroups.com Website: genbench.org/workshop On behalf of the GenBench team, Dieuwke Hupkes Khuyagbaatar Batsuren Koustuv Sinha Amirhossein Kazemnejad Christos Christodoulopoulos Ryan Cotterell Elia Bruni Verna Dankers

1 0

Free webinar on CL programmes 11 July 3pm UK time
by Brezina, Vaclav 10 Jul '23

10 Jul '23

Hi all, If you'd like to find out more about Corpus linguistics programmes (MA, Post-graduate Certificate) as well as individual courses for credit offered by Lancaster University - all online learning - please join us tomorrow for a free webinar: https://forms.office.com/e/82JE20Wx88 Best, Vaclav Professor Vaclav Brezina Professor in Corpus Linguistics Department of Linguistics and English Language ESRC Centre for Corpus Approaches to Social Science Faculty of Arts and Social Sciences, Lancaster University Lancaster, LA1 4YD Office: County South, room C05 T: +44 (0)1524 510828 [cid:5d86929e-b78e-40c0-87c3-97c565294b0d]@vaclavbrezina [cid:584b3354-e395-47db-8cef-48305a301d03]<http://www.lancaster.ac.uk/arts-and-social-sciences/about-us/people/vaclav-…>

1 0

BlackboxNLP 2023: The 6th Workshop on Analysing and Interpreting Neural Networks for NLP
by Hosein Mohebbi 10 Jul '23

10 Jul '23

*Call for Papers*: The sixth edition of BlackboxNLP, co-located with EMNLP 2023, in Singapore. *Important dates* --------------------- September 1, 2023 – Submission deadline. October 6, 2023 – Notification of acceptance. October 18, 2023 – Camera-ready papers due. December 7, 2023 – Workshop. Note: All deadlines are 11:59PM UTC-12 (anywhere on Earth). *Workshop description:* ----------------- Many recent performance improvements in NLP have come at the cost of understanding of the systems. How do we assess what representations and computations models learn? How do we formalize desirable properties of interpretable models, and measure the extent to which existing models achieve them? How can we build models that better encode these properties? What can new or existing tools tell us about these systems’ inductive biases? The goal of this workshop is to bring together researchers focused on interpreting and explaining NLP models by taking inspiration from fields such as machine learning, psychology, linguistics, and neuroscience. We hope the workshop will serve as an interdisciplinary meetup that allows for cross-collaboration. Topics of interest include, but are not limited to: * Applying analysis techniques from neuroscience to analyze high-dimensional vector representations in artificial neural networks; * Analyzing the network’s response to strategically chosen input in order to infer the linguistic generalizations that the network has acquired; * Examining network performance on simplified or formal languages; * Mechanistic interpretability, reverse engineering approaches to understanding particular properties of neural models; * Proposing modifications to neural architectures that increase their interpretability; * Testing whether interpretable information can be decoded from intermediate representations; * Explaining specific model predictions made by neural networks; * Generating and evaluating the quality of adversarial examples in NLP; * Developing open-source tools for analyzing neural networks in NLP; * Evaluating the analysis results: how do we know that the analysis is valid? *Submissions* ----------------- We call for two types of papers: 1) Archival papers. These are papers reporting on completed, original and unpublished research, with a maximum length of 8 pages + references. Papers shorter than this maximum are also welcome. Accepted papers are expected to be presented at the workshop and will be published in the workshop proceedings. They should report on obtained results rather than intended work. These papers will undergo double-blind peer-review, and should thus be anonymized. 2) Extended abstracts. These may report on work in progress or may be cross submissions that have already appeared in a non-NLP venue. The extended abstracts are of maximum 2 pages + references. These submissions are non-archival in order to allow submission to another venue. The selection will not be based on a double-blind review and thus submissions of this type need not be anonymized. Submissions should follow the official EMNLP 2023 style guidelines. *The submission site is:* https://www.softconf.com/emnlp2023/BlackboxNLP *Organizers* ----------------- Yonatan Belinkov, Technion Najoung Kim, Boston University Sophie Hao, New York University Arya McCarthy, Johns Hopkins University Jaap Jumelet, University of Amsterdam Hosein Mohebbi, Tilburg University *Contact* --------------------- Please contact the organizers at blackboxnlp(a)googlegroups.com for any questions. Read more: https://www.aclweb.org/portal/content/blackboxnlp-2023-6th-workshop-analysi…

1 0

Four fully-funded 5-year PhD positions at University of Gothenburg, Sweden
by Peter Ljunglöf 09 Jul '23

09 Jul '23

[Apologies for cross-posting] The University of Gothenburg, Sweden, is offering four fully-funded PhD positions in computer science and engineering where the candidates can choose the project themselves out of fourteen options. Two of the projects are related to NLP, one about efficient algorithms for corpus searching, and another about automatic generation of Wikipedia articles. See the ad for more information: https://web103.reachmee.com/ext/I005/1035/job?site=7&lang=UK&validator=9b89… The positions are fully funded for 5 years, including 20% teaching or other departemental duties. Application deadline: 20 August 2023 best regards, Peter Ljunglöf ------- ------ ----- ---- --- -- - - - - - peter ljunglöf peter.ljunglof(a)gu.se data- och informationsteknik, och språkbanken göteborgs universitet och chalmers tekniska högskola -------------- --------- -------- ------- ------ ----- ---- --- -- - - - - -

1 0

New articles for Asia Pacific Journal of Corpus Research (APJCR) Vol. 3, No. 1 are available online (Open Access)
by Prof CK Jung 08 Jul '23

08 Jul '23

Dear all Just wanted to let you know that APJCR Vol. 3, No. 1 is now available to view online. http://icr.or.kr/ejournals-apjcr CK --- *CK Jung BEng(Hons) Birmingham MSc Warwick EdD Warwick Cert Oxford* Department of English Language and Literature, Incheon National University, *South Korea* Vice President | The Korea Association of Primary English Education (KAPEE), *South Korea* Vice President | The Korea Association of Secondary English Education (KASEE), *South Korea* Director | Institute for Corpus Research, Incheon National University, *South Korea* (http://icr.or.kr) Editor | Asia Pacific Journal of Corpus Research, ICR, *International* ( http://icr.or.kr/apjcr) Deputy Editor | Korean Journal of English Language and Linguistics, KASELL, *South Korea* Editorial Board | Corpora, Edinburgh University Press, *UK* Editorial Board | English Today, Cambridge University Press, *UK* E: ckjung(a)inu.ac.kr / T: +82 (0)32 835 8129 H(EN): http://ckjung.org H(KR): http://prof1.inu.ac.kr/user/ckjung

1 12

2025

2024

2023

2022