NAACL 2025

1,927 papers

Transferable Post-training via Inverse Value Learning

Xinyu Lu, Xueru Wen, Yaojie Lu, Bowen Yu, Hongyu Lin

Threshold Filtering Packing for Supervised Fine-Tuning: Training Related Samples within Packs

Jiancheng Dong, Lei Jiang, Wei Jin, Lu Cheng

Efficient and Effective Prompt Tuning via Prompt Decomposition and Compressed Outer Product

Pengxiang Lan, Haoyu Xu, Enneng Yang, Yuliang Liang, Guibing Guo

Stronger Models are Not Always Stronger Teachers for Instruction Tuning

Zhangchen Xu, Fengqing Jiang, Luyao Niu, Bill Yuchen Lin, Radha Poovendran

Harnessing and Evaluating the Intrinsic Extrapolation Ability of Large Language Models for Vehicle Trajectory Prediction

Jiawei Liu, Yanjiao Liu, Xun Gong, Tingting Wang, Hong Chen

See-Saw Modality Balance: See Gradient, and Sew Impaired Vision-Language Balance to Mitigate Dominant Modality Bias

JuneHyoung Kwon, Mihyeon Kim, Eunju Lee, Juhwan Choi, YoungBin Kim

Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completion

Muzhi Li, Cehao Yang, Chengjin Xu, Xuhui Jiang, Yiyan Qi

Benchmarking and Building Zero-Shot Hindi Retrieval Model with Hindi-BEIR and NLLB-E5

Arkadeep Acharya, Rudra Murthy, Vishwajeet Kumar, Jaydeep Sen

Efficient Prompting for Continual Adaptation to Missing Modalities

Zirun Guo, Shulei Wang, Wang Lin, Weicai Yan, Yangyang Wu

AudioBench: A Universal Benchmark for Audio Large Language Models

Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu

SVD-LLM V2: Optimizing Singular Value Truncation for Large Language Model Compression

Xin Wang, Samiul Alam, Zhongwei Wan, Hui Shen, Mi Zhang

Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval

Yu Xia, Junda Wu, Sungchul Kim, Tong Yu, Ryan A. Rossi

Fighting Spurious Correlations in Text Classification via a Causal Learning Perspective

Yuqing Zhou, Ziwei Zhu

ToolFlow: Boosting LLM Tool-Calling Through Natural and Coherent Dialogue Synthesis

Zezhong Wang, Xingshan Zeng, Weiwen Liu, Liangyou Li, Yasheng Wang

PROMPTEVALS: A Dataset of Assertions and Guardrails for Custom Production Large Language Model Pipelines

Reya Vir, Shreya Shankar, Harrison Chase, William Hinthorn, Aditya Parameswaran

CVE-Bench: Benchmarking LLM-based Software Engineering Agent’s Ability to Repair Real-World CVE Vulnerabilities

Peiran Wang, Xiaogeng Liu, Chaowei Xiao

The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Yifan Song, Guoyin Wang, Sujian Li, Bill Yuchen Lin

Tricking Retrievers with Influential Tokens: An Efficient Black-Box Corpus Poisoning Attack

Cheng Wang, Yiwei Wang, Yujun Cai, Bryan Hooi

WaterPool: A Language Model Watermark Mitigating Trade-Offs among Imperceptibility, Efficacy and Robustness

Baizhou Huang, Xiaojun Wan

LLM4DistReconfig: A Fine-tuned Large Language Model for Power Distribution Network Reconfiguration

Panayiotis Christou, Md. Zahidul Islam, Yuzhang Lin, Jingwei Xiong

Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench

Zheyuan Liu, Guangyao Dou, Mengzhao Jia, Zhaoxuan Tan, Qingkai Zeng

KMMLU: Measuring Massive Multitask Language Understanding in Korean

Guijin Son, Hanwool Lee, Sungdong Kim, Seungone Kim, Niklas Muennighoff

Mutual-pairing Data Augmentation for Fewshot Continual Relation Extraction

Nguyen Hoang Anh, Quyen Tran, Thanh Xuan Nguyen, Nguyen Thi Ngoc Diep, Linh Ngo Van

Soft Prompting for Unlearning in Large Language Models

Karuna Bhaila, Minh-Hao Van, Xintao Wu

Communication Makes Perfect: Persuasion Dataset Construction via Multi-LLM Communication

Weicheng Ma, Hefan Zhang, Ivory Yang, Shiyu Ji, Joice Chen

How to Align Multiple Signed Language Corpora for Better Sign-to-Sign Translations?

Mert Inan, Yang Zhong, Vidya Ganesh, Malihe Alikhani

Sparser Mixture-of-Adapters with Cross-Layer Generalization

Ziyue Li, Tianyi Zhou

Temporal-Aware Soft Prompt Tuning for Automatic Text Dating

Hai Wang, Yuzhi Liang, Han Ren

Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering

Chenglei Si, Yanzhe Zhang, Ryan Li, Zhengyuan Yang, Ruibo Liu

Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping

Ryan Li, Yanzhe Zhang, Diyi Yang

An Efficient Gloss-Free Sign Language Translation Using Spatial Configurations and Motion Dynamics with LLMs

Eui Jun Hwang, Sukmin Cho, Junmyeong Lee, Jong C. Park

CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy

Mian Zhang, Xianjun Yang, Xinlu Zhang, Travis Labrum, Jamie C. Chiu

Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models

Juan Pablo Munoz, Jinjie Yuan, Nilesh Jain

CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments

Kung-Hsiang Huang, Akshara Prabhakar, Sidharth Dhawan, Yixin Mao, Huan Wang

ACCORD: Closing the Commonsense Measurability Gap

Francois Roewer-Despres, Jinyue Feng, Zining Zhu, Frank Rudzicz

VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models

Zejun Li, Ruipu Luo, Jiwen Zhang, Minghui Qiu, Xuanjing Huang

Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data

Jingyu Zhang, Marc Marone, Tianjian Li, Benjamin Van Durme, Daniel Khashabi

DPL: Diverse Preference Learning Without A Reference Model

Abhijnan Nath, Andrey Volozin, Saumajit Saha, Albert Aristotle Nanda, Galina Grunin

CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models

Jierui Li, Hung Le, Yingbo Zhou, Caiming Xiong, Silvio Savarese

TurkingBench: A Challenge Benchmark for Web Agents

Kevin Xu, Yeganeh Kordi, Tanay Nayak, Adi Asija, Yizhong Wang

CluSanT: Differentially Private and Semantically Coherent Text Sanitization

Ahmed Musa Awon, Yun Lu, Shera Potka, Alex Thomo

Towards Rationality in Language and Multimodal Agents: A Survey

Bowen Jiang, Yangxinyu Xie, Xiaomeng Wang, Yuan Yuan, Zhuoqun Hao

MatViX: Multimodal Information Extraction from Visually Rich Articles

Ghazal Khalighinejad, Sharon Scott, Ollie Liu, Kelly L. Anderson, Rickard Stureborg

Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM Sampling

Guangya Wan, Yuqi Wu, Jie Chen, Sheng Li

Unfamiliar Finetuning Examples Control How Language Models Hallucinate

Katie Kang, Eric Wallace, Claire Tomlin, Aviral Kumar, Sergey Levine

Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions

Hanjie Chen, Zhouxiang Fang, Yash Singla, Mark Dredze

Ihquin tlahtouah in Tetelahtzincocah: An annotated, multi-purpose audio and text corpus of Western Sierra Puebla Nahuatl

Robert Pugh, Cheyenne Wing, María Ximena Juárez Huerta, Ángeles Márquez Hernandez, Francis Tyers

Beyond End-to-End VLMs: Leveraging Intermediate Text Representations for Superior Flowchart Understanding

Junyi Ye, Ankan Dash, Wenpeng Yin, Guiling Wang

Can Unconfident LLM Annotations Be Used for Confident Conclusions?

Kristina Gligoric, Tijana Zrnic, Cinoo Lee, Emmanuel Candes, Dan Jurafsky

Beyond Benchmarks: Building a Richer Cross-Document Event Coreference Dataset with Decontextualization

Jin Zhao, Jingxuan Tu, Bingyang Ye, Xinrui Hu, Nianwen Xue

Who Relies More on World Knowledge and Bias for Syntactic Ambiguity Resolution: Humans or LLMs?

So Young Lee, Russell Scheinberg, Amber Shore, Ameeta Agrawal

Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Tools

Yilun Hao, Yongchao Chen, Yang Zhang, Chuchu Fan

Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization

Zilu Tang, Rajen Chatterjee, Sarthak Garg

When2Call: When (not) to Call Tools

Hayley Ross, Ameya Sunil Mahabaleshwarkar, Yoshi Suhara

PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensembles

Siyan Li, Vethavikashini Chithrra Raghuram, Omar Khattab, Julia Hirschberg, Zhou Yu

LLM The Genius Paradox: A Linguistic and Math Expert’s Struggle with Simple Word-based Counting Problems

Nan Xu, Xuezhe Ma

Upsample or Upweight? Balanced Training on Heavily Imbalanced Datasets

Tianjian Li, Haoran Xu, Weiting Tan, Kenton Murray, Daniel Khashabi

From Introspection to Best Practices: Principled Analysis of Demonstrations in Multimodal In-Context Learning

Nan Xu, Fei Wang, Sheng Zhang, Hoifung Poon, Muhao Chen

Smurfs: Multi-Agent System using Context-Efficient DFSDT for Tool Planning

Junzhi Chen, Juhao Liang, Benyou Wang

Extracting and Understanding the Superficial Knowledge in Alignment

Runjin Chen, Gabriel Jacob Perin, Xuxi Chen, Xilun Chen, Yan Han

WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines

Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan, David Anugraha, Rifki Afina Putri

Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models

Hengyi Wang, Haizhou Shi, Shiwei Tan, Weiyi Qin, Wenyuan Wang

Entangled Relations: Leveraging NLI and Meta-analysis to Enhance Biomedical Relation Extraction

William P Hogan, Jingbo Shang

Incremental Sentence Processing Mechanisms in Autoregressive Transformer Language Models

Michael Hanna, Aaron Mueller

Representing Rule-based Chatbots with Transformers

Dan Friedman, Abhishek Panigrahi, Danqi Chen

Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations

Yong Cao, Haijiang Liu, Arnav Arora, Isabelle Augenstein, Paul Röttger

LLMs Are Not Intelligent Thinkers: Introducing Mathematical Topic Tree Benchmark for Comprehensive Evaluation of LLMs

Arash Gholami Davoodi, Seyed Pouyan Mousavi Davoudi, Pouya Pezeshkpour

Superlatives in Context: Modeling the Implicit Semantics of Superlatives

Valentina Pyatkin, Bonnie Webber, Ido Dagan, Reut Tsarfaty

ERAS: Evaluating the Robustness of Chinese NLP Models to Morphological Garden Path Errors

Qinchan Li, Sophie Hao

A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagation

Bairu Hou, Yang Zhang, Jacob Andreas, Shiyu Chang

ToW: Thoughts of Words Improve Reasoning in Large Language Models

Zhikun Xu, Ming Shen, Jacob Dineen, Zhaonan Li, Xiao Ye

DREAM: Improving Video-Text Retrieval Through Relevance-Based Augmentation Using Large Foundation Models

Yimu Wang, Shuai Yuan, Bo Xue, Xiangru Jian, Wei Pang

Racing Thoughts: Explaining Contextualization Errors in Large Language Models

Michael A. Lepori, Michael Curtis Mozer, Asma Ghandeharioun

CORRECT: Context- and Reference-Augmented Reasoning and Prompting for Fact-Checking

Delvin Ce Zhang, Dongwon Lee

Prepending or Cross-Attention for Speech-to-Text? An Empirical Comparison

Tsz Kin Lam, Marco Gaido, Sara Papi, Luisa Bentivogli, Barry Haddow

The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioning

Longju Bai, Angana Borah, Oana Ignat, Rada Mihalcea

Towards Knowledge Checking in Retrieval-augmented Generation: A Representation Perspective

Shenglai Zeng, Jiankun Zhang, Bingheng Li, Yuping Lin, Tianqi Zheng

Entity Decomposition with Filtering: A Zero-Shot Clinical Named Entity Recognition Framework

Reza Averly, Xia Ning

Benchmarking Failures in Tool-Augmented Language Models

Eduardo Treviño, Hugo Contant, James Ngai, Graham Neubig, Zora Zhiruo Wang

Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders

Kshitish Ghate, Isaac Slaughter, Kyra Wilson, Mona T. Diab, Aylin Caliskan

ReGLA: Refining Gated Linear Attention

Peng Lu, Ivan Kobyzev, Mehdi Rezagholizadeh, Boxing Chen, Philippe Langlais

Multi-Conditional Ranking with Large Language Models

Pouya Pezeshkpour, Estevam Hruschka

A Bayesian Optimization Approach to Machine Translation Reranking

Julius Cheng, Maike Züfle, Vilém Zouhar, Andreas Vlachos

FactTrack: Time-Aware World State Tracking in Story Outlines

Zhiheng LYU, Kevin Yang, Lingpeng Kong, Dan Klein

Probe-Free Low-Rank Activation Intervention

Chonghe Jiang, Bao Nguyen, Anthony Man-Cho So, Viet Anh Nguyen

Have LLMs Reopened the Pandora’s Box of AI-Generated Fake News?

Xinyu Wang, Wenbo Zhang, Sai Koneru, Hangzhi Guo, Bonam Mingole

Benchmarking Language Model Creativity: A Case Study on Code Generation

Yining Lu, Dixuan Wang, Tianjian Li, Dongwei Jiang, Sanjeev Khudanpur

The Impact of Domain-Specific Terminology on Machine Translation for Finance in European Languages

Arturo Oncevay, Charese Smiley, Xiaomo Liu

IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

David Ifeoluwa Adelani, Jessica Ojo, Israel Abebe Azime, Jian Yun Zhuang, Jesujoba Oluwadara Alabi

DETQUS: Decomposition-Enhanced Transformers for QUery-focused Summarization

Yasir Khan, Xinlei Wu, Sangpil Youm, Justin Ho, Aryaan Mehboob Shaikh

ALERT: An LLM-powered Benchmark for Automatic Evaluation of Recommendation Explanations

Yichuan Li, Xinyang Zhang, Chenwei Zhang, Mao Li, Tianyi Liu

DTELS: Towards Dynamic Granularity of Timeline Summarization

Chenlong Zhang, Tong Zhou, Pengfei Cao, Zhuoran jin, Yubo Chen

Style Transfer with Multi-iteration Preference Optimization

Shuai Liu, Jonathan May

Reliability of Topic Modeling

Kayla Schroeder, Zach Wood-Doughty

SAPIENT: Mastering Multi-turn Conversational Recommendation with Strategic Planning and Monte Carlo Tree Search

Hanwen Du, Bo Peng, Xia Ning

Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessment

Kwanghee Choi, Eunjung Yeo, Kalvin Chang, Shinji Watanabe, David R Mortensen

HISTOIRESMORALES: A French Dataset for Assessing Moral Alignment

Thibaud Leteno, Irina Proskurina, Antoine Gourru, Julien Velcin, Charlotte Laclau

NLI under the Microscope: What Atomic Hypothesis Decomposition Reveals

Neha Srikanth, Rachel Rudinger

No Simple Answer to Data Complexity: An Examination of Instance-Level Complexity Metrics for Classification Tasks

Ryan A. Cook, John P. Lalor, Ahmed Abbasi

Exploring Large Language Models for Effective Rumor Detection on Social Media

Yirong Zeng, Xiao Ding, Bibo Cai, Ting Liu, Bing Qin