NAACL 2024

1,282 papers

The Role of n-gram Smoothing in the Age of Neural Networks

Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini

Transformers Can Represent n-gram Language Models

Anej Svete, Ryan Cotterell

Lower Bounds on the Expressivity of Recurrent Neural Language Models

Anej Svete, Franz Nowak, Anisha Sahabdeen, Ryan Cotterell

Instructing Large Language Models to Identify and Ignore Irrelevant Conditions

Zhenyu Wu, Chao Shen, Meng Jiang

Beyond Performance: Quantifying and Mitigating Label Bias in LLMs

Yuval Reif, Roy Schwartz

Divergent Token Metrics: Measuring degradation to prune away LLM components – and optimize quantization

Björn Deiseroth, Max Meuer, Nikolas Gritsch, Constantin Eichenberg, Patrick Schramowski

Mind’s Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models

Weize Liu, Guocong Li, Kai Zhang, Bang Du, Qiyuan Chen

Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey

Zhichen Dong, Zhanhui Zhou, Chao Yang, Jing Shao, Yu Qiao

Intent-conditioned and Non-toxic Counterspeech Generation using Multi-Task Instruction Tuning with RLAIF

Amey Hengle, Aswini Padhi, Sahajpreet Singh, Anil Bandhakavi, Md Shad Akhtar

LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation?

Yuchi Wang, Shuhuai Ren, Rundong Gao, Linli Yao, Qingyan Guo

XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners

Yun Luo, Zhen Yang, Fandong Meng, Yingjie Li, Fang Guo

ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications

Sotaro Takeshita, Tommaso Green, Ines Reinig, Kai Eckert, Simone Ponzetto

ComCLIP: Training-Free Compositional Image and Text Matching

Kenan Jiang, Xuehai He, Ruize Xu, Xin Wang

The Integration of Semantic and Structural Knowledge in Knowledge Graph Entity Typing

Muzhi Li, Minda Hu, Irwin King, Ho-fung Leung

Separation and Fusion: A Novel Multiple Token Linking Model for Event Argument Extraction

Jing Xu, Dandan Song, Siu Hui, Zhijing Wu, Meihuizi Jia

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References

Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang

A Survey of Confidence Estimation and Calibration in Large Language Models

Jiahui Geng, Fengyu Cai, Yuxia Wang, Heinz Koeppl, Preslav Nakov

GPTScore: Evaluate as You Desire

Jinlan Fu, See-Kiong Ng, Zhengbao Jiang, Pengfei Liu

PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers

Myeonghwa Lee, Seonho An, Min-Soo Kim

Entity Disambiguation via Fusion Entity Decoding

Junxiong Wang, Ali Mousavi, Omar Attia, Ronak Pradeep, Saloni Potdar

ContraDoc: Understanding Self-Contradictions in Documents with Large Language Models

Jierui Li, Vipul Raheja, Dhruv Kumar

CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions

Hanchong Zhang, Ruisheng Cao, Hongshen Xu, Lu Chen, Kai Yu

LinkPrompt: Natural and Universal Adversarial Attacks on Prompt-based Language Models

Yue Xu, Wenjie Wang

ToXCL: A Unified Framework for Toxic Speech Detection and Explanation

Nhat M. Hoang, Xuan Long Do, Duc Anh Do, Duc Anh Vu, Luu Anh Tuan

MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation

Jiahuan Li, Shanbo Cheng, Shujian Huang, Jiajun Chen

ScriptMix: Mixing Scripts for Low-resource Language Parsing

Jaeseong Lee, Dohyeon Lee, Seung-won Hwang

Toward Interactive Regional Understanding in Vision-Large Language Models

Jungbeom Lee, Sanghyuk Chun, Sangdoo Yun

Global Gallery: The Fine Art of Painting Culture Portraits through Multilingual Instruction Tuning

Anjishnu Mukherjee, Aylin Caliskan, Ziwei Zhu, Antonios Anastasopoulos

Grammar-based Data Augmentation for Low-Resource Languages: The Case of Guarani-Spanish Neural Machine Translation

Agustín Lucas, Alexis Baladón, Victoria Pardiñas, Marvin Agüero-Torales, Santiago Góngora

The Bias Amplification Paradox in Text-to-Image Generation

Preethi Seshadri, Sameer Singh, Yanai Elazar

Language Model Based Unsupervised Dependency Parsing with Conditional Mutual Information and Grammatical Constraints

Junjie Chen, Xiangheng He, Yusuke Miyao

Universal Prompt Optimizer for Safe Text-to-Image Generation

Zongyu Wu, Hongcheng Gao, Yueze Wang, Xiang Zhang, Suhang Wang

ContraSim – Analyzing Neural Representations Based on Contrastive Learning

Adir Rahamim, Yonatan Belinkov

When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale

Christos Baziotis, Biao Zhang, Alexandra Birch, Barry Haddow

Grounding Gaps in Language Model Generations

Omar Shaikh, Kristina Gligoric, Ashna Khetan, Matthias Gerstgrasser, Diyi Yang

Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models

Yijia Shao, Yucheng Jiang, Theodore Kanell, Peter Xu, Omar Khattab

Effective Large Language Model Adaptation for Improved Grounding and Citation Generation

Xi Ye, Ruoxi Sun, Sercan Arik, Tomas Pfister

SlimFit: Memory-Efficient Fine-Tuning of Transformer-based Models Using Training Dynamics

Arash Ardakani, Altan Haan, Shangyin Tan, Doru Thom Popovici, Alvin Cheung

Massive End-to-end Speech Recognition Models with Time Reduction

Weiran Wang, Rohit Prabhavalkar, Haozhe Shan, Zhong Meng, Dongseong Hwang

CMB: A Comprehensive Medical Benchmark in Chinese

Xidong Wang, Guiming Chen, Song Dingjie, Zhang Zhiyi, Zhihong Chen

GINopic: Topic Modeling with Graph Isomorphism Network

Suman Adhya, Debarshi Kumar Sanyal

DialogBench: Evaluating LLMs as Human-like Dialogue Systems

Jiao Ou, Junda Lu, Che Liu, Yihong Tang, Fuzheng Zhang

A Study on the Calibration of In-context Learning

Hanlin Zhang, Yifan Zhang, Yaodong Yu, Dhruv Madeka, Dean Foster

Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly

Changjiang Gao, Hongda Hu, Peng Hu, Jiajun Chen, Jixing Li

Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models

Shuaijie She, Shujian Huang, Xingyun Wang, Yanke Zhou, Jiajun Chen

Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection

Jun Yan, Vikas Yadav, Shiyang Li, Lichang Chen, Zheng Tang

PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language Models

Hyunjin Kim, Young Jin Kim, JinYeong Bak

TableLlama: Towards Open Large Generalist Models for Tables

Tianshu Zhang, Xiang Yue, Yifei Li, Huan Sun

AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages

Jiayi Wang, David Ifeoluwa Adelani, Sweta Agrawal, Marek Masiak, Ricardo Rei

Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection

Jianfeng He, Hang Su, Jason Cai, Igor Shalyminov, Hwanjun Song

Debiasing with Sufficient Projection: A General Theoretical Framework for Vector Representations

Enze Shi, Lei Ding, Linglong Kong, Bei Jiang

NLP Systems That Can’t Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helps

Kristina Gligoric, Myra Cheng, Lucia Zheng, Esin Durmus, Dan Jurafsky

AWESOME: GPU Memory-constrained Long Document Summarization using Memory Mechanism and Global Salient Content

Shuyang Cao, Lu Wang

ParallelPARC: A Scalable Pipeline for Generating Natural-Language Analogies

Oren Sultan, Yonatan Bitton, Ron Yosef, Dafna Shahaf

Modularized Multilingual NMT with Fine-grained Interlingua

Sungjun Lim, Yoonjung Choi, Sangha Kim

The ART of LLM Refinement: Ask, Refine, and Trust

Kumar Shridhar, Koustuv Sinha, Andrew Cohen, Tianlu Wang, Ping Yu

LSTDial: Enhancing Dialogue Generation via Long- and Short-Term Measurement Feedback

Guanghui Ye, Huan Zhao, Zixing Zhang, Xupeng Zha, Zhihua Jiang

How are Prompts Different in Terms of Sensitivity?

Sheng Lu, Hendrik Schuff, Iryna Gurevych

BPE-knockout: Pruning Pre-existing BPE Tokenisers with Backwards-compatible Morphological Semi-supervision

Thomas Bauwens, Pieter Delobelle

RESPROMPT: Residual Connection Prompting Advances Multi-Step Reasoning in Large Language Models

Song Jiang, Zahra Shakeri, Aaron Chan, Maziar Sanjabi, Hamed Firooz

Event Detection from Social Media for Epidemic Prediction

Tanmay Parekh, Anh Mac, Jiarui Yu, Yuxuan Dong, Syed Shahriar

Contextual Label Projection for Cross-Lingual Structured Prediction

Tanmay Parekh, I-Hung Hsu, Kuan-Hao Huang, Kai-Wei Chang, Nanyun Peng

TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition

Md Mahadi Hasan Nahid, Davood Rafiei

Do Large Language Models Rank Fairly? An Empirical Study on the Fairness of LLMs as Rankers

Yuan Wang, Xuyang Wu, Hsin-Tai Wu, Zhiqiang Tao, Yi Fang

Contrastive and Consistency Learning for Neural Noisy-Channel Model in Spoken Language Understanding

Suyoung Kim, Jiyeon Hwang, Ho-Young Jung

Code Models are Zero-shot Precondition Reasoners

Lajanugen Logeswaran, Sungryull Sohn, Yiwei Lyu, Anthony Liu, Dong-Ki Kim

Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsense

Siqi Shen, Lajanugen Logeswaran, Moontae Lee, Honglak Lee, Soujanya Poria

Exploring Key Point Analysis with Pairwise Generation and Graph Partitioning

Xiao Li, Yong Jiang, Shen Huang, Pengjun Xie, Gong Cheng

Open-Vocabulary Federated Learning with Multimodal Prototyping

Huimin Zeng, Zhenrui Yue, Dong Wang

Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation

Zhenrui Yue, Huimin Zeng, Yimeng Lu, Lanyu Shang, Yang Zhang

Generating Uncontextualized and Contextualized Questions for Document-Level Event Argument Extraction

Md Nayem Uddin, Enfa Rose George, Eduardo Blanco, Steven Corman

Sequential Compositional Generalization in Multimodal Models

Semih Yagcioglu, Osman Batur İnce, Aykut Erdem, Erkut Erdem, Desmond Elliott

Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness

Ashim Gupta, Rishanth Rajendhran, Nathan Stringham, Vivek Srikumar, Ana Marasović

AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs

Yassir Fathullah, Chunyang Wu, Egor Lakomkin, Ke Li, Junteng Jia

Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval Augmentation to Language Models

Seiji Maekawa, Hayate Iso, Sairam Gurajada, Nikita Bhutani

Multimodal Chart Retrieval: A Comparison of Text, Table and Image Based Approaches

Averi Nowak, Francesco Piccinno, Yasemin Altun

Mapping Long-term Causalities in Psychiatric Symptomatology and Life Events from Social Media

Siyuan Chen, Meilin Wang, Minghao Lv, Zhiling Zhang, Qianqian Ju

LLatrieval: LLM-Verified Retrieval for Verifiable Generation

Xiaonan Li, Changtai Zhu, Linyang Li, Zhangyue Yin, Tianxiang Sun

DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade

Zefan Cai, Xin Zheng, Tianyu Liu, Haoran Meng, Jiaqi Han

Fine-grained Gender Control in Machine Translation with Large Language Models

Minwoo Lee, Hyukhun Koh, Minsung Kim, Kyomin Jung

Carpe diem: On the Evaluation of World Knowledge in Lifelong Language Models

Yujin Kim, Jaehong Yoon, Seonghyeon Ye, Sangmin Bae, Namgyu Ho

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models

Paul Röttger, Hannah Kirk, Bertie Vidgen, Giuseppe Attanasio, Federico Bianchi

GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformer

Urchade Zaratiana, Nadi Tomeh, Pierre Holat, Thierry Charnois

Enhancing Large Language Models Against Inductive Instructions with Dual-critique Prompting

Rui Wang, Hongru Wang, Fei Mi, Boyang Xue, Yi Chen

To Translate or Not to Translate: A Systematic Investigation of Translation-Based Cross-Lingual Transfer to Low-Resource Languages

Benedikt Ebing, Goran Glavaš

MacGyver: Are Large Language Models Creative Problem Solvers?

Yufei Tian, Abhilasha Ravichander, LIANHUI Qin, Ronan Le Bras, Raja Marjieh

CASA: Causality-driven Argument Sufficiency Assessment

Xiao Liu, Yansong Feng, Kai-Wei Chang

You don’t need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instruments

Bangzhao Shu, Lechen Zhang, Minje Choi, Lavinia Dunagan, Lajanugen Logeswaran

DLM: A Decoupled Learning Model for Long-tailed Polyphone Disambiguation in Mandarin

Beibei Gao, Yangsen Zhang, Ga Xiang, Yushan Jiang

EMONA: Event-level Moral Opinions in News Articles

Yuanyuan Lei, Md Messal Monem Miah, Ayesha Qamar, Sai Ramana Reddy, Jonathan Tong

Sentence-level Media Bias Analysis with Event Relation Graph

Yuanyuan Lei, Ruihong Huang

Polarity Calibration for Opinion Summarization

Yuanyuan Lei, Kaiqiang Song, SangWoo Cho, Xiaoyang Wang, Ruihong Huang

Does GPT-4 pass the Turing test?

Cameron R. Jones, Benjamin K. Bergen

Zero-shot Generative Linguistic Steganography

Ke Lin, Yiyang Luo, Zijian Zhang, Luo Ping

MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasets

Hossein Aboutalebi, Hwanjun Song, Yusheng Xie, Arshit Gupta, Lijia Sun

Teaching Language Models to Self-Improve through Interactive Demonstrations

Xiao Yu, Baolin Peng, Michel Galley, Jianfeng Gao, Zhou Yu

Where are you from? Geolocating Speech and Applications to Language Identification

Patrick Foley, Matthew Wiesner, Bismarck Bamfo Odoom, Leibny Paola Garcia, Kenton Murray

Generating Mental Health Transcripts with SAPE (Spanish Adaptive Prompt Engineering)

Daniel Lozoya, Alejandro Berazaluce, Juan Perches, Eloy Lúa, Mike Conway

Revisiting subword tokenization: A case study on affixal negation in large language models

Thinh Hung Truong, Yulia Otmakhova, Karin Verspoor, Trevor Cohn, Timothy Baldwin

SportQA: A Benchmark for Sports Understanding in Large Language Models

Haotian Xia, Zhengbang Yang, Yuqing Wang, Rhys Tracy, Yun Zhao