ACL 2024

2,718 papers

Stealthy Attack on Large Language Model based Recommendation

Jinghao Zhang, Yuting Liu, Qiang Liu, Shu Wu, Guibing Guo

Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questions

Liyan Xu, Jiangnan Li, Mo Yu, Jie Zhou

Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection

Zihan Ma, Minnan Luo, Hao Guo, Zhi Zeng, Yiran Hao

GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick

Jiayi Fu, Xuandong Zhao, Ruihan Yang, Yuansen Zhang, Jiangjie Chen

RepCodec: A Speech Representation Codec for Speech Tokenization

Zhichao Huang, Chutong Meng, Tom Ko

PRP-Graph: Pairwise Ranking Prompting to LLMs with Graph Aggregation for Effective Text Re-ranking

Jian Luo, Xuanang Chen, Ben He, Le Sun

Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptation

Xiang Luo, Zhiwen Tang, Jin Wang, Xuejie Zhang

A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques

Megh Thakkar, Quentin Fournier, Matthew Riemer, Pin-Yu Chen, Amal Zouaq

Forgetting before Learning: Utilizing Parametric Arithmetic for Knowledge Updating in Large Language Models

Shiwen Ni, Dingwei Chen, Chengming Li, Xiping Hu, Ruifeng Xu

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models

Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang

Benchmarking Data Science Agents

Yuge Zhang, Qiyang Jiang, XingyuHan XingyuHan, Nan Chen, Yuqing Yang

Speaker Verification in Agent-generated Conversations

Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Ee-Peng Lim

Learning Geometry-Aware Representations for New Intent Discovery

Kai Tang, Junbo Zhao, Xiao Ding, Runze Wu, Lei Feng

Experiential Co-Learning of Software-Developing Agents

Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Zihao Xie

Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?

Guijin Son, SangWon Baek, Sangdae Nam, Ilgyun Jeong, Seungone Kim

SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding

Zhangchen Xu, Fengqing Jiang, Luyao Niu, Jinyuan Jia, Bill Yuchen Lin

Digital Socrates: Evaluating LLMs through Explanation Critiques

Yuling Gu, Oyvind Tafjord, Peter Clark

CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Weixiang Yan, Haitian Liu, Yunkun Wang, Yunzhe Li, Qian Chen

NICE: To Optimize In-Context Examples or Not?

Pragya Srivastava, Satvik Golechha, Amit Deshpande, Amit Sharma

Jailbreak Open-Sourced Large Language Models via Enforced Decoding

Hangfan Zhang, Zhimeng Guo, Huaisheng Zhu, Bochuan Cao, Lu Lin

Threads of Subtlety: Detecting Machine-Generated Texts Through Discourse Motifs

Zae Myung Kim, Kwang Lee, Preston Zhu, Vipul Raheja, Dongyeop Kang

What Do Language Models Hear? Probing for Auditory Representations in Language Models

Jerry Ngo, Yoon Kim

Instruction-tuned Language Models are Better Knowledge Learners

Zhengbao Jiang, Zhiqing Sun, Weijia Shi, Pedro Rodriguez, Chunting Zhou

Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizers

Lütfi Kerem Senel, Besnik Fetahu, Davis Yoshida, Zhiyu Chen, Giuseppe Castellucci

Noise Correction on Subjective Datasets

Uthman Jinadu, Yi Ding

Your Transformer is Secretly Linear

Anton Razzhigaev, Matvey Mikhalchuk, Elizaveta Goncharova, Nikolai Gerasimenko, Ivan Oseledets

Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimization

Wenqi Zhang, Ke Tang, Hai Wu, Mengna Wang, Yongliang Shen

Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learning

Jingbiao Mei, Jinghong Chen, Weizhe Lin, Bill Byrne, Marcus Tomalin

Triple-Encoders: Representations That Fire Together, Wire Together

Justus-Jonas Erker, Florian Mai, Nils Reimers, Gerasimos Spanakis, Iryna Gurevych

PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers

Weizhe Lin, Jingbiao Mei, Jinghong Chen, Bill Byrne

UHGEval: Benchmarking the Hallucination of Chinese Large Language Models via Unconstrained Generation

Xun Liang, Shichao Song, Simin Niu, Zhiyu Li, Feiyu Xiong

Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment

Tao Jin, Wang Lin, Ye Wang, Linjun Li, Xize Cheng

PCAD: Towards ASR-Robust Spoken Language Understanding via Prototype Calibration and Asymmetric Decoupling

Xianwei Zhuang, Xuxin Cheng, Liming Liang, Yuxin Xie, Zhichang Wang

Beyond Scaling: Predicting Patent Approval with Domain-specific Fine-grained Claim Dependency Graph

Xiaochen Gao, Feng Yao, Kewen Zhao, Beilei He, Animesh Kumar

Marathon: A Race Through the Realm of Long Context with Large Language Models

Lei Zhang, Yunshui Li, Ziqiang Liu, Jiaxi Yang, Junhao Liu

Quantifying Uncertainty in Answers from any Language Model and Enhancing their Trustworthiness

Jiuhai Chen, Jonas Mueller

OLIVE: Object Level In-Context Visual Embeddings

Timothy Ossowski, Junjie Hu

Eliciting Better Multilingual Structured Reasoning from LLMs through Code

Bryan Li, Tamer Alkhouli, Daniele Bonadiman, Nikolaos Pappas, Saab Mansour

WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning

Zhaojian Yu, Xin Zhang, Ning Shang, Yangyu Huang, Can Xu

Are Emergent Abilities in Large Language Models just In-Context Learning?

Sheng Lu, Irina Bigoulaeva, Rachneet Sachdeva, Harish Tayyar Madabushi, Iryna Gurevych

Estimating Agreement by Chance for Sequence Annotation

Diya Li, Carolyn Rose, Ao Yuan, Chunxiao Zhou

Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language Representations

Gregor Geigle, Radu Timofte, Goran Glavaš

Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models

Jinhao Duan, Hao Cheng, Shiqi Wang, Alex Zavalny, Chenan Wang

PITA: Prompting Task Interaction for Argumentation Mining

Yang Sun, Muyi Wang, Jianzhu Bao, Bin Liang, Xiaoyan Zhao

QueryAgent: A Reliable and Efficient Reasoning Framework with Environmental Feedback based Self-Correction

Xiang Huang, Sitao Cheng, Shanshan Huang, Jiayu Shen, Yong Xu

LLM Knows Body Language, Too: Translating Speech Voices into Human Gestures

Chenghao Xu, Guangtao Lyu, Jiexi Yan, Muli Yang, Cheng Deng

Open Grounded Planning: Challenges and Benchmark Construction

Shiguang Guo, Ziliang Deng, Hongyu Lin, Yaojie Lu, Xianpei Han

Boosting Language Models Reasoning with Chain-of-Knowledge Prompting

Jianing Wang, Qiushi Sun, Xiang Li, Ming Gao

RelayAttention for Efficient Large Language Model Serving with Long System Prompts

LEI ZHU, Xinjiang Wang, Wayne Zhang, Rynson Lau

MapCoder: Multi-Agent Code Generation for Competitive Problem Solving

Md. Ashraful Islam, Mohammed Eunus Ali, Md Rizwan Parvez

Who Wrote this Code? Watermarking for Code Generation

Taehyun Lee, Seokhee Hong, Jaewoo Ahn, Ilgee Hong, Hwaran Lee

Temporal Knowledge Question Answering via Abstract Reasoning Induction

Ziyang Chen, Dongfang Li, Xiang Zhao, Baotian Hu, Min Zhang

Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition

Matteo Bortoletto, Constantin Ruhdorfer, Adnen Abdessaied, Lei Shi, Andreas Bulling

Systematic Task Exploration with LLMs: A Study in Citation Text Generation

Furkan Şahinuç, Ilia Kuznetsov, Yufang Hou, Iryna Gurevych

DiffuCOMET: Contextual Commonsense Knowledge Diffusion

Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji

Spectral Filters, Dark Signals, and Attention Sinks

Nicola Cancedda

Planning Like Human: A Dual-process Framework for Dialogue Planning

Tao He, Lizi Liao, Yixin Cao, Yuanxing Liu, Ming Liu

SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models

Md Imbesat Rizvi, Xiaodan Zhu, Iryna Gurevych

When Only Time Will Tell: Interpreting How Transformers Process Local Ambiguities Through the Lens of Restart-Incrementality

Brielen Madureira, Patrick Kahardipraja, David Schlangen

DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning

Yejie Wang, Keqing He, Guanting Dong, Pei Wang, Weihao Zeng

Learning to Edit: Aligning LLMs with Knowledge Editing

Yuxin Jiang, Yufei Wang, Chuhan Wu, Wanjun Zhong, Xingshan Zeng

FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models

Yuxin Jiang, Yufei Wang, Xingshan Zeng, Wanjun Zhong, Liangyou Li

NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents

Tamara Czinczoll, Christoph Hönes, Maximilian Schall, Gerard de Melo

Re3: A Holistic Framework and Dataset for Modeling Collaborative Document Revision

Qian Ruan, Ilia Kuznetsov, Iryna Gurevych

A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains

Alon Jacovi, Yonatan Bitton, Bernd Bohnet, Jonathan Herzig, Or Honovich

Navigating the OverKill in Large Language Models

Chenyu Shi, Xiao Wang, Qiming Ge, Songyang Gao, Xianjun Yang

One-Shot Learning as Instruction Data Prospector for Large Language Models

Yunshui Li, Binyuan Hui, Xiaobo Xia, Jiaxi Yang, Min Yang

StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback

Shihan Dou, Yan Liu, Haoxiang Jia, Enyu Zhou, Limao Xiong

Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators

Matéo Mahaut, Laura Aina, Paula Czarnowska, Momchil Hardalov, Thomas Müller

Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Types

Pierluigi Cassotti, Stefano De Pascale, Nina Tahmasebi

Interpretability of Language Models via Task Spaces

Lucas Weber, Jaap Jumelet, Elia Bruni, Dieuwke Hupkes

Exploiting Intrinsic Multilateral Logical Rules for Weakly Supervised Natural Language Video Localization

Zhe Xu, Kun Wei, Xu Yang, Cheng Deng

Analyzing Semantic Change through Lexical Replacements

Francesco Periti, Pierluigi Cassotti, Haim Dubossarsky, Nina Tahmasebi

Graph Language Models

Moritz Plenz, Anette Frank

LLM-based Rewriting of Inappropriate Argumentation using Reinforcement Learning from Machine Feedback

Timon Ziegenbein, Gabriella Skitalinskaya, Alireza Bayat Makou, Henning Wachsmuth

Favi-Score: A Measure for Favoritism in Automated Preference Ratings for Generative AI Evaluation

Pius Von Däniken, Jan Deriu, Don Tuggener, Mark Cieliebak

Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs

Jiejun Tan, Zhicheng Dou, Yutao Zhu, Peidong Guo, Kun Fang

Uncovering the Full Potential of Visual Grounding Methods in VQA

Daniel Reich, Tanja Schultz

Missci: Reconstructing Fallacies in Misrepresented Science

Max Glockner, Yufang Hou, Preslav Nakov, Iryna Gurevych

Uncertainty-Guided Modal Rebalance for Hateful Memes Detection

Chuanpeng Yang, Yaxin Liu, Fuqing Zhu, Jizhong Han, Songlin Hu

SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graph

Hanzhu Chen, Xu Shen, Qitan Lv, Jie Wang, Xiaoqi Ni

Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors

Mengge Xue, Zhenyu Hu, Liqun Liu, Kuo Liao, Shuang Li

DAPR: A Benchmark on Document-Aware Passage Retrieval

Kexin Wang, Nils Reimers, Iryna Gurevych

CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following

Kaiyan Zhang, Jianyu Wang, Ermo Hua, Biqing Qi, Ning Ding

InfoLossQA: Characterizing and Recovering Information Loss in Text Simplification

Jan Trienes, Sebastian Joseph, Jörg Schlötterer, Christin Seifert, Kyle Lo

CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending

Shiyi Zhu, Jing Ye, Wei Jiang, Siqiao Xue, Qi Zhang

Intuitive or Dependent? Investigating LLMs’ Behavior Style to Conflicting Prompts

Jiahao Ying, Yixin Cao, Kai Xiong, Long Cui, Yidong He

Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

Kuo Liao, Shuang Li, Meng Zhao, Liqun Liu, Mengge Xue

Transferable Embedding Inversion Attack: Uncovering Privacy Risks in Text Embeddings without Model Queries

Yu-Hsiang Huang, Yuche Tsai, Hsiang Hsiao, Hong-Yi Lin, Shou-De Lin

Respond in my Language: Mitigating Language Inconsistency in Response Generation based on Large Language Models

Liang Zhang, Qin Jin, Haoyang Huang, Dongdong Zhang, Furu Wei

In-context Mixing (ICM): Code-mixed Prompts for Multilingual LLMs

Bhavani Shankar, Preethi Jyothi, Pushpak Bhattacharyya

Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselors

Alicja Chaszczewicz, Raj Shah, Ryan Louie, Bruce Arnow, Robert Kraut

Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models

Zhiwei He, Binglin Zhou, Hongkun Hao, Aiwei Liu, Xing Wang

NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes

Lizhou Fan, Wenyue Hua, Lingyao Li, Haoyang Ling, Yongfeng Zhang

MAVEN-ARG: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation

Xiaozhi Wang, Hao Peng, Yong Guan, Kaisheng Zeng, Jianhui Chen

CaMML: Context-Aware Multimodal Learner for Large Models

Yixin Chen, SHUAI ZHANG, Boran Han, Tong He, Bo Li

Learning Global Controller in Latent Space for Parameter-Efficient Fine-Tuning

Zeqi Tan, Yongliang Shen, Xiaoxia Cheng, Chang Zong, Wenqi Zhang

Rule or Story, Which is a Better Commonsense Expression for Talking with Large Language Models?

Ning Bian, Xianpei Han, Hongyu Lin, Yaojie Lu, Ben He

SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training

Nan He, Weichen Xiong, Hanwen Liu, Yi Liao, Lei Ding

Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue

Jian Wang, Chak Tou Leong, Jiashuo WANG, Dongding Lin, Wenjie Li