ACL 2024

2,718 papers

Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models

Mosh Levy, Alon Jacoby, Yoav Goldberg

AI ‘News’ Content Farms Are Easy to Make and Hard to Detect: A Case Study in Italian

Giovanni Puccetti, Anna Rogers, Chiara Alzetta, Felice Dell’Orletta, Andrea Esuli

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Kirk

Natural Language Satisfiability: Exploring the Problem Distribution and Evaluating Transformer-based Language Models

Tharindu Madusanka, Ian Pratt-Hartmann, Riza Batista-Navarro

∞Bench: Extending Long Context Evaluation Beyond 100K Tokens

Xinrong Zhang, Yingfa Chen, Shengding Hu, Zihang Xu, Junhao Chen

Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversation

Dongjin Kang, Sunghwan Kim, Taeyoon Kwon, Seungjun Moon, Hyunsouk Cho

PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety

Zaibin Zhang, Yongting Zhang, Lijun Li, Hongzhi Gao, Lijun Wang

Disentangled Learning with Synthetic Parallel Data for Text Style Transfer

Jingxuan Han, Quan Wang, Zikang Guo, Benfeng Xu, Licheng Zhang

ChatDev: Communicative Agents for Software Development

Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang

ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs

Fengqing Jiang, Zhangchen Xu, Luyao Niu, Zhen Xiang, Bhaskar Ramasubramanian

Tree-Averaging Algorithms for Ensemble-Based Unsupervised Discontinuous Constituency Parsing

Behzad Shayegh, Yuqiao Wen, Lili Mou

What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages

Nadav Borenstein, Anej Svete, Robin Chan, Josef Valvoda, Franz Nowak

WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations

Haolin Deng, Chang Wang, Xin Li, Dezhang Yuan, Junlang Zhan

MultiLegalPile: A 689GB Multilingual Legal Corpus

Joel Niklaus, Veton Matoshi, Matthias Stürmer, Ilias Chalkidis, Daniel Ho

MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling

Tomasz Limisiewicz, Terra Blevins, Hila Gonen, Orevaoghene Ahia, Luke Zettlemoyer

The Echoes of Multilinguality: Tracing Cultural Value Shifts during Language Model Fine-tuning

Rochelle Choenni, Anne Lauscher, Ekaterina Shutova

IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators

Indraneil Paul, Goran Glavaš, Iryna Gurevych

Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction

Haoqiu Yan, Yongxin Zhu, Kai Zheng, Bing Liu, Haoyu Cao

Why are Sensitive Functions Hard for Transformers?

Michael Hahn, Mark Rofin

Latxa: An Open Language Model and Evaluation Suite for Basque

Julen Etxaniz, Oscar Sainz, Naiara Perez, Itziar Aldabe, German Rigau

Spiral of Silence: How is Large Language Model Killing Information Retrieval?—A Case Study on Open Domain Question Answering

Xiaoyang Chen, Ben He, Hongyu Lin, Xianpei Han, Tianshu Wang

Must NLP be Extractive?

Steven Bird

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

Samuel Cahyawijaya, Holy Lovenia, Fajri Koto, Rifki Afina Putri, Emmanuel Dave

How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study

Andreas Waldis, Yufang Hou, Iryna Gurevych

Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models

Junhao Zheng, Shengjie Qiu, Qianli Ma

Disinformation Capabilities of Large Language Models

Ivan Vykopal, Matúš Pikuliak, Ivan Srba, Robert Moro, Dominik Macko

Arabic Diacritics in the Wild: Exploiting Opportunities for Improved Diacritization

Salman Elgamal, Ossama Obeid, Mhd Kabbani, Go Inoue, Nizar Habash

D2LLM: Decomposed and Distilled Large Language Models for Semantic Search

Zihan Liao, Hang Yu, Jianguo Li, Jun Wang, Wei Zhang

Speech vs. Transcript: Does It Matter for Human Annotators in Speech Summarization?

Roshan Sharma, Suwon Shon, Mark Lindsey, Hira Dhamyal, Bhiksha Raj

Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?

Marco Gaido, Sara Papi, Matteo Negri, Luisa Bentivogli

Semisupervised Neural Proto-Language Reconstruction

Liang Lu, Peirong Xie, David Mortensen

Mission: Impossible Language Models

Julie Kallini, Isabel Papadimitriou, Richard Futrell, Kyle Mahowald, Christopher Potts

Don’t Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaboration

Shangbin Feng, Weijia Shi, Yike Wang, Wenxuan Ding, Vidhisha Balachandran

CausalGym: Benchmarking causal interpretability methods on linguistic tasks

Aryaman Arora, Dan Jurafsky, Christopher Potts

Distributional Inclusion Hypothesis and Quantifications: Probing for Hypernymy in Functional Distributional Semantics

Chun Hei Lo, Wai Lam, Hong Cheng, Guy Emerson

MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module Plugin

Tianshuo Zhou, Sen Mei, Xinze Li, Zhenghao Liu, Chenyan Xiong

Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

Jintian Zhang, Xin Xu, Ningyu Zhang, Ruibo Liu, Bryan Hooi

Emergent Word Order Universals from Cognitively-Motivated Language Models

Tatsuki Kuribayashi, Ryo Ueda, Ryo Yoshida, Yohei Oseki, Ted Briscoe

Towards Better Understanding of Contrastive Sentence Representation Learning: A Unified Paradigm for Gradient

Mingxin Li, Richong Zhang, Zhijie Nie

PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents

Qisen Yang, Zekun Wang, Honghui Chen, Shenzhi Wang, Yifan Pu

Causal-Guided Active Learning for Debiasing Large Language Models

Zhouhao Sun, Li Du, Xiao Ding, Yixuan Ma, Yang Zhao

DIALECTBENCH: An NLP Benchmark for Dialects, Varieties, and Closely-Related Languages

Fahim Faisal, Orevaoghene Ahia, Aarohi Srivastava, Kabir Ahuja, David Chiang

L-Eval: Instituting Standardized Evaluation for Long Context Language Models

Chenxin An, Shansan Gong, Ming Zhong, Xingjian Zhao, Mukai Li

Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models

Lei Li, Yuqi Wang, Runxin Xu, Peiyi Wang, Xiachong Feng

The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models

Adithya Bhaskar, Dan Friedman, Danqi Chen

How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs

Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang, Ruoxi Jia

DeVAn: Dense Video Annotation for Video-Language Models

Tingkai Liu, Yunzhe Tao, Haogeng Liu, Qihang Fang, Ding Zhou

IAPT: Instance-Aware Prompt Tuning for Large Language Models

Wei Zhu, Aaron Tian, Congrui Yin, Yuan Ni, Xiaoling Wang

Confabulation: The Surprising Value of Large Language Model Hallucinations

Peiqi Sui, Eamon Duede, Sophie Wu, Richard So

Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning

Ming Li, Yong Zhang, Shwai He, Zhitao Li, Hongyu Zhao

LogogramNLP: Comparing Visual and Textual Representations of Ancient Logographic Writing Systems for NLP

Danlu Chen, Freda Shi, Aditi Agarwal, Jacobo Myerston, Taylor Berg-Kirkpatrick

Controlled Text Generation for Black-box Language Models via Score-based Progressive Editor

Sangwon Yu, Changmin Lee, Hojin Lee, Sungroh Yoon

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation

Jiachen Zhao, Wenlong Zhao, Andrew Drozdov, Benjamin Rozonoyer, Md Arafat Sultan

Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models

Shengzhi Li, Rongyu Lin, Shichao Pei

EWEK-QA : Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems

Mohammad Dehghan, Mohammad Alomrani, Sunyam Bagga, David Alfonso-hermelo, Khalil Bibi

Tracking the Newsworthiness of Public Documents

Alexander Spangher, Serdar Tumgoren, Ben Welsh, Nanyun Peng, Emilio Ferrara

Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic

Rishabh Bhardwaj, Duc Anh Do, Soujanya Poria

Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models

Martin Riddell, Ansong Ni, Arman Cohan

GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Construction

Virginia Felkner, Jennifer Thompson, Jonathan May

Representation Learning with Conditional Information Flow Maximization

Dou Hu, Lingwei Wei, Wei Zhou, Songlin Hu

DeCoT: Debiasing Chain-of-Thought for Knowledge-Intensive Tasks in Large Language Models via Causal Intervention

Junda Wu, Tong Yu, Xiang Chen, Haoliang Wang, Ryan Rossi

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Pratyush Maini, Skyler Seto, Richard Bai, David Grangier, Yizhe Zhang

What is the Best Way for ChatGPT to Translate Poetry?

Shanshan Wang, Derek Wong, Jingming Yao, Lidia Chao

Explanation-aware Soft Ensemble Empowers Large Language Model In-context Learning

Yue Yu, Jiaming Shen, Tianqi Liu, Zhen Qin, Jing Nathan Yan

Fora: A corpus and framework for the study of facilitated dialogue

Hope Schroeder, Deb Roy, Jad Kabbara

Transparent and Scrutable Recommendations Using Natural Language User Profiles

Jerome Ramos, Hossein A. Rahmani, Xi Wang, Xiao Fu, Aldo Lipani

The MERSA Dataset and a Transformer-Based Approach for Speech Emotion Recognition

Enshi Zhang, Rafael Trujillo, Christian Poellabauer

Skin-in-the-Game: Decision Making via Multi-Stakeholder Alignment in LLMs

Bilgehan Sel, Priya Shanmugasundaram, Mohammad Kachuee, Kun Zhou, Ruoxi Jia

Impacts of Misspelled Queries on Translation and Product Search

Greg Hanneman, Natawut Monaikul, Taichi Nakatani

NEO-BENCH: Evaluating Robustness of Large Language Models with Neologisms

Jonathan Zheng, Alan Ritter, Wei Xu

Prototypical Reward Network for Data-Efficient RLHF

Jinghan Zhang, Xiting Wang, Yiqiao Jin, Changyu CHEN, Xinhao Zhang

Evaluating Very Long-Term Conversational Memory of LLM Agents

Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri

LIEDER: Linguistically-Informed Evaluation for Discourse Entity Recognition

Xiaomeng Zhu, Robert Frank

LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts

Helia Hashemi, Jason Eisner, Corby Rosset, Benjamin Van Durme, Chris Kedzie

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

Norah Alzahrani, Hisham Alyahya, Yazeed Alnumay, Sultan AlRashed, Shaykhah Alsubaie

REFINESUMM: Self-Refining MLLM for Generating a Multimodal Summarization Dataset

Vaidehi Patil, Leonardo F. R. Ribeiro, Mengwen Liu, Mohit Bansal, Markus Dreyer

Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models

Zihao Lin, Mohammad Beigi, Hongxuan Li, Yufan Zhou, Yuxiang Zhang

Reducing Privacy Risks in Online Self-Disclosures with Language Models

Yao Dou, Isadora Krsek, Tarek Naous, Anubha Kabra, Sauvik Das

Meta-Tuning LLMs to Leverage Lexical Knowledge for Generalizable Language Style Understanding

Ruohao Guo, Wei Xu, Alan Ritter

LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models

Mihir Parmar, Nisarg Patel, Neeraj Varshney, Mutsumi Nakamura, Man Luo

When is Tree Search Useful for LLM Planning? It Depends on the Discriminator

Ziru Chen, Michael White, Ray Mooney, Ali Payani, Yu Su

CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges

Kechi Zhang, Jia Li, Ge Li, Xianjie Shi, Zhi Jin

Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training

Junqing He, Kunhao Pan, Xiaoqun Dong, Zhuoyang Song, Yibo Liu

HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position

Kechi Zhang, Ge Li, Huangzhao Zhang, Zhi Jin

Spatially-Aware Speaker for Vision-and-Language Navigation Instruction Generation

Muraleekrishna Gopinathan, Martin Masek, Jumana Abu-Khalaf, David Suter

MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech

Shengpeng Ji, Ziyue Jiang, Hanting Wang, Jialong Zuo, Zhou Zhao

MULFE: A Multi-Level Benchmark for Free Text Model Editing

Chenhao Wang, Pengfei Cao, Zhuoran jin, Yubo Chen, Daojian Zeng

Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels

Zixia Jia, Junpeng Li, Shichuan Zhang, Anji Liu, Zilong Zheng

ArchCode: Incorporating Software Requirements in Code Generation with Large Language Models

Hojae Han, Jaejin Kim, Jaeseok Yoo, Youngwon Lee, Seung-won Hwang

Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers

Jiawen Xie, Pengyu Cheng, Xiao Liang, Yong Dai, Nan Du

Using Natural Language Explanations to Improve Robustness of In-context Learning

Xuanli He, Yuxiang Wu, Oana-Maria Camburu, Pasquale Minervini, Pontus Stenetorp

Context Consistency between Training and Inference in Simultaneous Machine Translation

Meizhi Zhong, Lemao Liu, Kehai Chen, Mingming Yang, Min Zhang

Advancing Parameter Efficiency in Fine-tuning via Representation Editing

Muling Wu, Wenhao Liu, Xiaohua Wang, Tianlong Li, Changze Lv

WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protection

Anudeex Shetty, Yue Teng, Ke He, Qiongkai Xu

PathReasoner: Modeling Reasoning Path with Equivalent Extension for Logical Question Answering

Fangzhi Xu, Qika Lin, Tianzhe Zhao, JiaweiHan JiaweiHan, Jun Liu

ESCoT: Towards Interpretable Emotional Support Dialogue Systems

Tenggan Zhang, Xinjie Zhang, Jinming Zhao, Li Zhou, Qin Jin

Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends

Giuliano Martinelli, Edoardo Barba, Roberto Navigli

S2GSL: Incorporating Segment to Syntactic Enhanced Graph Structure Learning for Aspect-based Sentiment Analysis

Bingfeng Chen, Qihan Ouyang, Yongqi Luo, Boyan Xu, Ruichu Cai

Faithful Logical Reasoning via Symbolic Chain-of-Thought

Jundong Xu, Hao Fei, Liangming Pan, Qian Liu, Mong-Li Lee

Bridging Word-Pair and Token-Level Metaphor Detection with Explainable Domain Mining

Yuan Tian, Ruike Zhang, Nan Xu, Wenji Mao