NAACL 2024

1,282 papers

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning

Ruiyi Zhang, Rushi Qiang, Sai Ashish Somayajula, Pengtao Xie

Language Models Implement Simple Word2Vec-style Vector Arithmetic

Jack Merullo, Carsten Eickhoff, Ellie Pavlick

Improving Pre-trained Language Model Sensitivity via Mask Specific losses: A case study on Biomedical NER

Micheal Abaho, Danushka Bollegala, Gary Leeming, Dan Joyce, Iain Buchan

Leveraging Code to Improve In-Context Learning for Semantic Parsing

Ben Bogin, Shivanshu Gupta, Peter Clark, Ashish Sabharwal

Detecting Bipolar Disorder from Misdiagnosed Major Depressive Disorder with Mood-Aware Multi-Task Learning

Daeun Lee, Hyolim Jeon, Sejung Son, Chaewon Park, Ji Hyun An

Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts

Sai Ashish Somayajula, Youwei Liang, Li Zhang, Abhishek Singh, Pengtao Xie

Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections

Yuanpu Cao, Bochuan Cao, Jinghui Chen

Finding Replicable Human Evaluations via Stable Ranking Probability

Parker Riley, Daniel Deutsch, George Foster, Viresh Ratnakar, Ali Dabirmoghaddam

Anisotropy is Not Inherent to Transformers

Anemily Machina, Robert Mercer

Multi-stage Retrieve and Re-rank Model for Automatic Medical Coding Recommendation

Xindi Wang, Robert Mercer, Frank Rudzicz

No Context Needed: Contextual Quandary In Idiomatic Reasoning With Pre-Trained Language Models

Kellen Tan Cheng, Suma Bhat

Diffusion Glancing Transformer for Parallel Sequence-to-Sequence Learning

Lihua Qian, Mingxuan Wang, Yang Liu, Hao Zhou

MAFALDA: A Benchmark and Comprehensive Study of Fallacy Detection and Classification

Chadi Helwe, Tom Calamai, Pierre-Henri Paris, Chloé Clavel, Fabian Suchanek

Lost in Transcription: Identifying and Quantifying the Accuracy Biases of Automatic Speech Recognition Systems Against Disfluent Speech

Dena Mujtaba, Nihar Mahapatra, Megan Arney, J Yaruss, Hope Gerlach-Houck

Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt

Yongqi Wang, Ruofan Hu, Rongjie Huang, Zhiqing Hong, Ruiqi Li

In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax

Aaron Mueller, Albert Webson, Jackson Petty, Tal Linzen

Investigating the Emergent Audio Classification Ability of ASR Foundation Models

Rao Ma, Adian Liusie, Mark Gales, Kate Knill

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification

He Zhu, Junran Wu, Ruomei Liu, Yue Hou, Ze Yuan

Visually Guided Generative Text-Layout Pre-training for Document Intelligence

Zhiming Mao, Haoli Bai, Lu Hou, Lifeng Shang, Xin Jiang

Fake Alignment: Are LLMs Really Aligned Well?

Yixu Wang, Yan Teng, Kexin Huang, Chengqi Lyu, Songyang Zhang

Aligning as Debiasing: Causality-Aware Alignment via Reinforcement Learning with Interventional Feedback

Yu Xia, Tong Yu, Zhankui He, Handong Zhao, Julian McAuley

Empowering Diffusion Models on the Embedding Space for Text Generation

Zhujin Gao, Junliang Guo, Xu Tan, Yongxin Zhu, Fang Zhang

Effective Long-Context Scaling of Foundation Models

Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava

Generating Attractive and Authentic Copywriting from Customer Reviews

Yu-Xiang Lin, Wei-Yun Ma

Extending CLIP’s Image-Text Alignment to Referring Image Segmentation

Seoyeon Kim, Minguk Kang, Dongwon Kim, Jaesik Park, Suha Kwak

Mitigating Bias for Question Answering Models by Tracking Bias Influence

Mingyu Ma, Jiun-Yu Kao, Arpit Gupta, Yu-Hsiang Lin, Wenbo Zhao

Flames: Benchmarking Value Alignment of LLMs in Chinese

Kexin Huang, Xiangyang Liu, Qianyu Guo, Tianxiang Sun, Jiawei Sun

Personalized Jargon Identification for Enhanced Interdisciplinary Communication

Yue Guo, Joseph Chee Chang, Maria Antoniak, Erin Bransom, Trevor Cohen

Backdoor Attacks on Multilingual Machine Translation

Jun Wang, Qiongkai Xu, Xuanli He, Benjamin Rubinstein, Trevor Cohn

Fixing Rogue Memorization in Many-to-One Multilingual Translators of Extremely-Low-Resource Languages by Rephrasing Training Samples

Paulo Cavalin, Pedro Henrique Domingues, Claudio Pinhanez, Julio Nogima

MOKA: Moral Knowledge Augmentation for Moral Event Extraction

Xinliang Frederick Zhang, Winston Wu, Nick Beauchamp, Lu Wang

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

Liyan Tang, Igor Shalyminov, Amy Wong, Jon Burnsky, Jake Vincent

Impossible Distillation for Paraphrasing and Summarization: How to Make High-quality Lemonade out of Small, Low-quality Model

Jaehun Jung, Peter West, Liwei Jiang, Faeze Brahman, Ximing Lu

Memory Augmented Language Models through Mixture of Word Experts

Cicero Nogueira dos Santos, James Lee-Thorp, Isaac Noble, Chung-Ching Chang, David Uthus

Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Dataset

Janis Goldzycher, Paul Röttger, Gerold Schneider

Differentially Private Next-Token Prediction of Large Language Models

James Flemings, Meisam Razaviyayn, Murali Annavaram

The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education

Paiheng Xu, Jing Liu, Nathan Jones, Julie Cohen, Wei Ai

A Comprehensive Study of Gender Bias in Chemical Named Entity Recognition Models

Xingmeng Zhao, Ali Niazi, Anthony Rios

ODD: A Benchmark Dataset for the Natural Language Processing Based Opioid Related Aberrant Behavior Detection

Sunjae Kwon, Xun Wang, Weisong Liu, Emily Druhl, Minhee Sung

Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark

Stephen Mayhew, Terra Blevins, Shuheng Liu, Marek Suppa, Hila Gonen

Rectifying Demonstration Shortcut in In-Context Learning

Joonwon Jang, Sanghwan Jang, Wonbin Kweon, Minjin Jeon, Hwanjo Yu

iACOS: Advancing Implicit Sentiment Extraction with Informative and Adaptive Negative Examples

Xiancai Xu, Jia-Dong Zhang, Lei Xiong, Zhishang Liu

A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Change

Francesco Periti, Nina Tahmasebi

Encoding of lexical tone in self-supervised models of spoken language

Gaofei Shen, Michaela Watkins, Afra Alishahi, Arianna Bisazza, Grzegorz Chrupała

Generalizable Sarcasm Detection is Just Around the Corner, of Course!

Hyewon Jang, Diego Frassinelli

Enhancing Contextual Understanding in Large Language Models through Contrastive Decoding

Zheng Zhao, Emilio Monti, Jens Lehmann, Haytham Assem

Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis

Nayeon Lee, Chani Jung, Junho Myung, Jiho Jin, Jose Camacho-Collados

MDR: Model-Specific Demonstration Retrieval at Inference Time for In-Context Learning

Huazheng Wang, Jinming Wu, Haifeng Sun, Zixuan Xia, Daixuan Cheng

XNLIeu: a dataset for cross-lingual NLI in Basque

Maite Heredia, Julen Etxaniz, Muitze Zulaika, Xabier Saralegi, Jeremy Barnes

Automatic Restoration of Diacritics for Speech Data Sets

Sara Shatnawi, Sawsan Alqahtani, Hanan Aldarmaki

EDC: Effective and Efficient Dialog Comprehension For Dialog State Tracking

Qifan Lu, Bhaskar Ramasubramanian, Radha Poovendran

Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarization

Santosh T.y.s.s, Vatsal Venkatkrishna, Saptarshi Ghosh, Matthias Grabmair

DoG-Instruct: Towards Premium Instruction-Tuning Data via Text-Grounded Instruction Wrapping

Yongrui Chen, Haiyun Jiang, Xinting Huang, Shuming Shi, Guilin Qi

Event-Content-Oriented Dialogue Generation in Short Video

Fenghua Cheng, Xue Li, Zi Huang, Jinxiang Wang, Sen Wang

Better Zero-Shot Reasoning with Role-Play Prompting

Aobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li, Yong Qin

Media Bias Detection Across Families of Language Models

Iffat Maab, Edison Marrese-Taylor, Sebastian Padó, Yutaka Matsuo

SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation

Abe Hou, Jingyu Zhang, Tianxing He, Yichen Wang, Yung-Sung Chuang

HTCCN: Temporal Causal Convolutional Networks with Hawkes Process for Extrapolation Reasoning in Temporal Knowledge Graphs

Tingxuan Chen, Jun Long, Liu Yang, Zidong Wang, Yongheng Wang

Advancing Beyond Identification: Multi-bit Watermark for Large Language Models

KiYoon Yoo, Wonhyuk Ahn, Nojun Kwak

CONSCENDI: A Contrastive and Scenario-Guided Distillation Approach to Guardrail Models for Virtual Assistants

Albert Sun, Varun Nair, Elliot Schumacher, Anitha Kannan

LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models

Chi Han, Qifan Wang, Hao Peng, Wenhan Xiong, Yu Chen

Take One Step at a Time to Know Incremental Utility of Demonstration: An Analysis on Reranking for Few-Shot In-Context Learning

Kazuma Hashimoto, Karthik Raman, Michael Bendersky

Pedagogically Aligned Objectives Create Reliable Automatic Cloze Tests

Brian Ondov, Kush Attal, Dina Demner-Fushman

Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey

Garima Agrawal, Tharindu Kumarage, Zeyad Alghamdi, Huan Liu

Okay, Let’s Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation

Abhijnan Nath, Shadi Manafi Avari, Avyakta Chelle, Nikhil Krishnaswamy

Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Models

Aldo Carranza, Rezsa Farahani, Natalia Ponomareva, Alexey Kurakin, Matthew Jagielski

Towards Improved Multi-Source Attribution for Long-Form Answer Generation

Nilay Patel, Shivashankar Subramanian, Siddhant Garg, Pratyay Banerjee, Amita Misra

LanguageFlow: Advancing Diffusion Language Generation with Probabilistic Flows

Shujian Zhang, Lemeng Wu, Chengyue Gong, Xingchao Liu

Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generation

Xingwei Tan, Yuxiang Zhou, Gabriele Pergola, Yulan He

This Land is Your, My Land: Evaluating Geopolitical Bias in Language Models through Territorial Disputes

Bryan Li, Samar Haider, Chris Callison-Burch

On-the-fly Definition Augmentation of LLMs for Biomedical NER

Monica Munnangi, Sergey Feldman, Byron Wallace, Silvio Amir, Tom Hope

MapGuide: A Simple yet Effective Method to Reconstruct Continuous Language from Brain Activities

Xinpei Zhao, Jingyuan Sun, Shaonan Wang, Jing Ye, Xiaohan Zhang

TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Prediction

Shuo Li, Sangdon Park, Insup Lee, Osbert Bastani

Analyzing the Role of Semantic Representations in the Era of Large Language Models

Zhijing Jin, Yuen Chen, Fernando Gonzalez Adauto, Jiarui Liu, Jiayi Zhang

Long-form evaluation of model editing

Domenic Rosati, Robie Gonzales, Jinkun Chen, Xuemin Yu, Yahya Kayani

LayoutPointer: A Spatial-Context Adaptive Pointer Network for Visual Information Extraction

Huang Siyuan, Yongping Xiong, Wu Guibin

A Zero-Shot Monolingual Dual Stage Information Retrieval System for Spanish Biomedical Systematic Literature Reviews

Regina Ofori-Boateng, Magaly Aceves-Martins, Nirmalie Wiratunga, Carlos Moreno-Garcia

Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks

Chonghua Wang, Haodong Duan, Songyang Zhang, Dahua Lin, Kai Chen

Elote, Choclo and Mazorca: on the Varieties of Spanish

Cristina España-Bonet, Alberto Barrón-Cedeño

Curriculum Masking in Vision-Language Pretraining to Maximize Cross Modal Interaction

Kraig Tou, Zijun Sun

Know When To Stop: A Study of Semantic Drift in Text Generation

Ava Spataru, Eric Hambro, Elena Voita, Nicola Cancedda

Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models

Stephan Linzbach, Dimitar Dimitrov, Laura Kallmeyer, Kilian Evang, Hajira Jabeen

SharpSeq: Empowering Continual Event Detection through Sharpness-Aware Sequential-task Learning

Thanh-Thien Le, Viet Dao, Linh Nguyen, Thi-Nhung Nguyen, Linh Ngo

Analyzing the Use of Metaphors in News Editorials for Political Framing

Meghdut Sengupta, Roxanne El Baff, Milad Alshomary, Henning Wachsmuth

Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications

Yanchen Liu, Srishti Gautam, Jiaqi Ma, Himabindu Lakkaraju

Multimodal Multi-loss Fusion Network for Sentiment Analysis

Zehui Wu, Ziwei Gong, Jaywon Koo, Julia Hirschberg

Complex Claim Verification with Evidence Retrieved in the Wild

Jifan Chen, Grace Kim, Aniruddh Sriram, Greg Durrett, Eunsol Choi

Making Language Models Better Tool Learners with Execution Feedback

Shuofei Qiao, Honghao Gui, Chengfei Lv, Qianghuai Jia, Huajun Chen

Low-Cost Generation and Evaluation of Dictionary Example Sentences

Bill Cai, Ng Clarence, Daniel Liang, Shelvia Hotama

My Heart Skipped a Beat! Recognizing Expressions of Embodied Emotion in Natural Language

Yuan Zhuang, Tianyu Jiang, Ellen Riloff

Subspace Representations for Soft Set Operations and Sentence Similarities

Yoichi Ishibashi, Sho Yokoi, Katsuhito Sudoh, Satoshi Nakamura

Event Causality Is Key to Computational Story Understanding

Yidan Sun, Qin Chao, Boyang Li

GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives

Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo, Aida Mostafazadeh Davani, Alicia Parrish

Show Your Work with Confidence: Confidence Bands for Tuning Curves

Nicholas Lourie, Kyunghyun Cho, He He

What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases

Anthony Tiong, Junqi Zhao, Boyang Li, Junnan Li, Steven Hoi

Fair Abstractive Summarization of Diverse Perspectives

Yusen Zhang, Nan Zhang, Yixin Liu, Alexander Fabbri, Junru Liu

A Preference-driven Paradigm for Enhanced Translation with Large Language Models

Dawei Zhu, Sony Trenous, Xiaoyu Shen, Dietrich Klakow, Bill Byrne

HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM

Zhilin Wang, Yi Dong, Jiaqi Zeng, Virginia Adams, Makesh Narsimhan Sreedhar

Uncertainty Quantification for In-Context Learning of Large Language Models

Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu

Few-shot Knowledge Graph Relational Reasoning via Subgraph Adaptation

Haochen Liu, Song Wang, Chen Chen, Jundong Li