EMNLP 2023

2,732 papers

Scent and Sensibility: Perception Shifts in the Olfactory Domain

Teresa Paccosi, Stefano Menini, Elisa Leonardelli, Ilaria Barzon, Sara Tonelli

Automating Sound Change Prediction for Phylogenetic Inference: A Tukanoan Case Study

Kalvin Chang, Nathaniel Robinson, Anna Cai, Ting Chen, Annie Zhang

Semantic Shifts in Mental Health-Related Concepts

Naomi Baes, Nick Haslam, Ekaterina Vylomova

Changing usage of Low Saxon auxiliary and modal verbs

Janine Siewert, Martijn Wieling, Yves Scherrer

Towards Detecting Lexical Change of Hate Speech in Historical Data

Sanne Hoeken, Sophie Spliethoff, Silke Schwandt, Sina Zarrieß, Özge Alaçam

ChiWUG: A Graph-based Evaluation Dataset for Chinese Lexical Semantic Change Detection

Jing Chen, Emmanuele Chersoni, Dominik Schlechtweg, Jelena Prokić, Chu-Ren Huang

Anchors in Embedding Space: A Simple Concept Tracking Approach to Support Conceptual History Research

Jetske Adams, Martha Larson, Jaap Verheul, Michael Boyden

Multi-lect automatic detection of Swadesh list items from raw corpus data in East Slavic languages

Ilia Afanasev

EvoSem: A database of polysemous cognate sets

Mathieu Dehouck, Alex François, Siva Kalyan, Martial Pastor, David Kletz

Political dogwhistles and community divergence in semantic change

Max Boholm, Asad Sayeed

A longitudinal study about gradual changes in the Iranian Online Public Sphere pre and post of ‘Mahsa Moment’: Focusing on Twitter

Sadegh Jafari, Amin Fathi, Abolfazl Hajizadegan, Amirmohammad Kazemeini, Sauleh Eetemadi

GHisBERT – Training BERT from scratch for lexical semantic investigations across historical German language stages

Christin Beck, Marisa Köllner

Representing and Computing Uncertainty in Phonological Reconstruction

Johann-Mattis List, Nathan Hill, Robert Forkel, Frederic Blum

Domain-Adapting BERT for Attributing Manuscript, Century and Region in Pre-Modern Slavic Texts

Piroska Lendvai, Uwe Reichel, Anna Jouravel, Achim Rabus, Elena Renje

Literary Intertextual Semantic Change Detection: Application and Motivation for Evaluating Models on Small Corpora

Jackson Ehrenworth, Katherine Keith

Shifted PAUQ: Distribution shift in text-to-SQL

Oleg Somov, Elena Tutubalina

On using distribution-based compositionality assessment to evaluate compositional generalisation in machine translation

Anssi Moisio, Mathias Creutz, Mikko Kurimo

Cross-Lingual Data Augmentation For Thai Question-Answering

Parinthapat Pengpun, Can Udomcharoenchaikit, Weerayut Buaphet, Peerat Limkonchotiwat

GQG: Generalized Quantifier Generalization - A Dataset for Evaluating Quantifier Semantics Understanding in Language Models

Leroy Zhifei Wang, Shane Steinert-Threlkeld

In-Context Learning for Text Classification with Many Labels

Aristides Milios, Siva Reddy, Dzmitry Bahdanau

Blackbird Language Matrices Tasks for Generalization

Paola Merlo, Chunyang Jiang, Giuseppe Samo, Vivi Nastase

Inductive Bias Is in the Eye of the Beholder

Michael Wilson, Robert Frank

mSCAN: A Dataset for Multilingual Compositional Generalisation Evaluation

Amélie Reymond, Shane Steinert-Threlkeld

Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments

Danial Kamali, Parisa Kordjamshidi

Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study

Maike Züfle, Verna Dankers, Ivan Titov

Walking a Tightrope – Evaluating Large Language Models in High-Risk Domains

Chia-Chien Hung, Wiem Ben Rim, Lindsay Frost, Lars Bruckner, Carolin Lawrence

Robust Generalization Strategies for Morpheme Glossing in an Endangered Language Documentation Context

Michael Ginn, Alexis Palmer

Temporal Generalizability in Multimodal Misinformation Detection

Nataliya Stepanova, Bjorn Ross

Robust Code Summarization

Debanjan Mondal, Abhilasha Lodha, Ankita Sahoo, Beena Kumari

Evaluating Neural Language Models as Cognitive Models of Language Acquisition

Héctor Javier Vázquez Martínez, Annika Heuser, Charles Yang, Jordan Kodner

Adapt and Decompose: Efficient Generalization of Text-to-SQL via Domain Adapted Least-To-Most Prompting

Aseem Arora, Shabbirhussain Bhaisaheb, Harshit Nigam, Manasi Patwardhan, Lovekesh Vig

GenCodeSearchNet: A Benchmark Test Suite for Evaluating Generalization in Programming Language Understanding

Andor Diera, Abdelhalim Dahou, Lukas Galke, Fabian Karl, Florian Sihler

90% F1 Score in Relation Triple Extraction: Is it Real?

Pratik Saini, Samiran Pal, Tapas Nayak, Indrajit Bhattacharya

A Simple yet Efficient Ensemble Approach for AI-generated Text Detection

Harika Abburi, Kalyani Roy, Michael Suesserman, Nirmala Pudota, Balaji Veeramani

Post Turing: Mapping the landscape of LLM Evaluation

Alexey Tikhonov, Ivan P. Yamshchikov

How well ChatGPT understand Malaysian English? An Evaluation on Named Entity Recognition and Relation Extraction

MohanRaj Chanthran, Lay-Ki Soon, Ong Huey Fang, Bhawani Selvaretnam

PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits

Ehsan Lotfi, Maxime De Bruyn, Jeska Buhmann, Walter Daelemans

Elo Uncovered: Robustness and Best Practices in Language Model Evaluation

Meriem Boubdir, Edward Kim, Beyza Ermis, Sara Hooker, Marzieh Fadaee

Separating the Wheat from the Chaff with BREAD: An open-source benchmark and metrics to detect redundancy in text

Isaac Caswell, Lisa Wang, Isabel Papadimitriou

RankAug: Augmented data ranking for text classification

Tiasa Roy, Priyam Basu

Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs

Xue-yong Fu, Md Tahmid Rahman Laskar, Cheng Chen, Shashi Bhushan Tn

To Burst or Not to Burst: Generating and Quantifying Improbable Text

Kuleen Sasse, Efsun Sarioglu Kayi, Samuel Barham, Edward Staley

Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity

Joseph Gatto, Omar Sharif, Parker Seegmiller, Philip Bohlman, Sarah M. Preum

Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses

Xenia Ohmer, Elia Bruni, Dieuwke Hupkes

Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness

Valentin Barriere, Felipe del Rio, Andres Carvallo, Carlos Aspillaga, Eugenio Herrera-Berg

Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation

David Demeter, Oshin Agarwal, Simon Ben Igeri, Marko Sterbentz, Neil Molino

ChatGPT as a Java Decompiler

Bradley McDanel, Zhanhao Liu

Flesch or Fumble? Evaluating Readability Standard Alignment of Instruction-Tuned Language Models

Joseph Marvin Imperial, Harish Tayyar Madabushi

An Empirical Bayes Framework for Open-Domain Dialogue Generation

Jing Yang Lee, Kong Aik Lee, Woon Seng Gan

Synthetic Dialogue Dataset Generation using LLM Agents

Yelaman Abdullin, Diego Molla, Bahadorreza Ofoghi, John Yearwood, Qingyang Li

Context and Literacy Aware Learnable Metric for Text Simplification

Jeongwon Kwak, Hyeryun Park, Kyungmo Kim, Jinwook Choi

Harnessing the Plug-and-Play Controller by Prompting

Hao Wang, Lei Sha

Towards Effective Long-Form QA with Evidence Augmentation

Mengxia Yu, Sara Rosenthal, Mihaela Bornea, Avi Sil

Predicting Question-Answering Performance of Large Language Models through Semantic Consistency

Ella Rabinovich, Samuel Ackerman, Orna Raz, Eitan Farchi, Ateret Anaby Tavor

Adapting Pre-trained Generative Models for Extractive Question Answering

Prabir Mallick, Tapas Nayak, Indrajit Bhattacharya

Unveiling Safety Vulnerabilities of Large Language Models

George Kour, Marcel Zalmanovici, Naama Zwerdling, Esther Goldbraich, Ora Fandina

QAMPARI: A Benchmark for Open-domain Questions with Many Answers

Samuel Amouyal, Tomer Wolfson, Ohad Rubin, Ori Yoran, Jonathan Herzig

Leveraging Large Language Models for Enhanced Product Descriptions in eCommerce

Jianghong Zhou, Bo Liu, Jhalak Acharya, Yao Hong, Kuang-chih Lee

One-Shot and Few-Shot Exemplification Modeling

John Harvill, Hee Suk Yoon, Eunseop Yoon, Mark Hasegawa-Johnson, Chang Yoo

Automatic Reflection Generation for Peer-to-Peer Counseling

Emma O’neil, João Sedoc, Diyi Yang, Haiyi Zhu, Lyle Ungar

Effective Proxy for Human Labeling: Ensemble Disagreement Scores in Large Language Models for Industrial NLP

Wei Du, Laksh Advani, Yashmeet Gambhir, Daniel Perry, Prashant Shiralkar

Automatic Evaluation of Generative Models with Instruction Tuning

Shuhaib Mehri, Vered Shwartz

Formalizing content creation and evaluation methods for AI-generated social media content

Christian Jensen, Axel Højmark

Dialogue Quality and Emotion Annotations for Customer Support Conversations

John Mendonça, Patrícia Pereira, Miguel Menezes, Vera Cabarrão, Ana C Farinha

Contextualizing the Limits of Model & Evaluation Dataset Curation on Semantic Similarity Classification Tasks

Daniel Theron

McGill at CRAC 2023: Multilingual Generalization of Entity-Ranking Coreference Resolution Models

Ian Porada, Jackie Chi Kit CHEUNG

ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution

Milan Straka

Neural End-to-End Coreference Resolution using Morphological Information

Tuğba Pamay Arslan, Kutay Acar, Gülşen Eryiǧit

Multilingual coreference resolution: Adapt and Generate

Natalia Skachkova, Tatiana Anikina, Anna Mokhova

Findings of the Second Shared Task on Multilingual Coreference Resolution

Zdeněk Žabokrtský, Miloslav Konopík, Anna Nedoluzhko, Michal Novák, Maciej Ogrodniczuk

Integrated Annotation of Event Structure, Object States, and Entity Coreference

Kyeongmin Rim, James Pustejovsky

Towards Harmful Erotic Content Detection through Coreference-Driven Contextual Analysis

Inez Okulska, Emilia Wiśnios

MARRS: Multimodal Reference Resolution System

Halim Cagri Ates, Shruti Bhargava, Site Li, Jiarui Lu, Siddhardha Maddula

The pragmatics of characters’ mental perspectives in pronominal reference resolution

Tiana Simovic, Craig Chambers

Better Handling Coreference Resolution in Aspect Level Sentiment Classification by Fine-Tuning Language Models

Dhruv Mullick, Bilal Ghanem, Alona Fyshe

Scalar Anaphora: Annotating Degrees of Coreference in Text

Bingyang Ye, Jingxuan Tu, James Pustejovsky

Towards Transparency in Coreference Resolution: A Quantum-Inspired Approach

Hadi Wazni, Mehrnoosh Sadrzadeh

CAW-coref: Conjunction-Aware Word-level Coreference Resolution

Karel D’Oosterlinck, Semere Kiros Bitew, Brandon Papineau, Christopher Potts, Thomas Demeester

Filling in the Gaps: Efficient Event Coreference Resolution using Graph Autoencoder Networks

Loic De Langhe, Orphee De Clercq, Véronique Hoste

Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitching

Tolúlọpẹ́ Ògúnrẹ̀mí, Christopher D. Manning, Dan Jurafsky

Unified Model for Code-Switching Speech Recognition and Language Identification Based on Concatenated Tokenizer

Kunal Dhawan, KDimating Rekesh, Boris Ginsburg

CONFLATOR: Incorporating Switching Point based Rotatory Positional Encodings for Code-Mixed Language Modeling

Mohsin Mohammed, Sai Kandukuri, Neeharika Gupta, Parth Patwa, Anubhab Chatterjee

Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages

Zheng-Xin Yong, Ruochen Zhang, Jessica Zosa Forde, Skyler Wang, Arjun Subramonian

Text-Derived Language Identity Incorporation for End-to-End Code-Switching Speech Recognition

Qinyi Wang, Haizhou Li

Language Preference for Expression of Sentiment for Nepali-English Bilingual Speakers on Social Media

Niraj Pahari, Kazutaka Shimada

Towards Real-World Streaming Speech Translation for Code-Switched Speech

Belen Alastruey, Matthias Sperber, Christian Gollan, Dominic Telaar, Tim Ng

TongueSwitcher: Fine-Grained Identification of German-English Code-Switching

Igor Sterner, Simone Teufel

Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model

Abhijith Chintam, Rahel Beloch, Willem Zuidema, Michael Hanna, Oskar Van Der Wal

On Quick Kisses and How to Make Them Count: A Study on Event Construal in Light Verb Constructions with BERT

Chenxin Liu, Emmanuele Chersoni

Systematic Generalization by Finetuning? Analyzing Pretrained Language Models Using Constituency Tests

Aishik Chakraborty, Jackie CK Cheung, Timothy J. O’Donnell

Memory Injections: Correcting Multi-Hop Reasoning Failures During Inference in Transformer-Based Language Models

Mansi Sakarvadia, Aswathy Ajith, Arham Khan, Daniel Grzenda, Nathaniel Hudson

NPIs Aren’t Exactly Easy: Variation in Licensing across Large Language Models

Deanna DeCarlo, William Palmer, Michael Wilson, Bob Frank

Rigorously Assessing Natural Language Explanations of Neurons

Jing Huang, Atticus Geiger, Karel D’Oosterlinck, Zhengxuan Wu, Christopher Potts

Not Wacky vs. Definitely Wacky: A Study of Scalar Adverbs in Pretrained Language Models

Isabelle Lorge, Janet B. Pierrehumbert

Layered Bias: Interpreting Bias in Pretrained Large Language Models

Nirmalendu Prakash, Roy Ka-Wei Lee

Evaluating Transformer’s Ability to Learn Mildly Context-Sensitive Languages

Shunjie Wang, Shane Steinert-Threlkeld

Investigating the Encoding of Words in BERT’s Neurons Using Feature Textualization

Tanja Baeumel, Soniya Vijayakumar, Josef van Genabith, Guenter Neumann, Simon Ostermann

How Much Consistency Is Your Accuracy Worth?

Jacob K. Johnson, Ana Marasović

METAPROBE: A Representation- and Task-Agnostic Probe

Yichu Zhou, Vivek Srikumar

Investigating the Effect of Discourse Connectives on Transformer Surprisal: Language Models Understand Connectives, Even So They Are Surprised

Yan Cong, Emmanuele Chersoni, Yu-Yin Hsu, Philippe Blache