ACL 2025

4,141 papers

Verify with Caution: The Pitfalls of Relying on Imperfect Factuality Metrics

Ameya Godbole, Robin Jia

Tokens for Learning, Tokens for Unlearning: Mitigating Membership Inference Attacks in Large Language Models via Dual-Purpose Training

Toan Tran, Ruixuan Liu, Li Xiong

Exploiting Phonetics and Glyph Representation at Radical-level for Classical Chinese Understanding

Junyi Xiang, Maofu Liu

Evaluating LLMs’ Mathematical and Coding Competency through Ontology-guided Interventions

Pengfei Hong, Navonil Majumder, Deepanway Ghosal, Somak Aditya, Rada Mihalcea

Inductive Linguistic Reasoning with Large Language Models

Raghav Ramji, Keshav Ramji

Q-STRUM Debate: Query-Driven Contrastive Summarization for Recommendation Comparison

George-Kirollos Saad, Scott Sanner

Metagent-P: A Neuro-Symbolic Planning Agent with Metacognition for Open Worlds

Yanfang Zhou, Yuntao Liu, Xiaodong Li, Yongqiang Zhao, Xintong Wang

Beyond instruction-conditioning, MoTE: Mixture of Task Experts for Multi-task Embedding Models

Miguel Romero Calvo, Shuoyang Ding, Corey D Barrett, Georgiana Dinu, George Karypis

Explain then Rank: Scale Calibration of Neural Rankers Using Natural Language Explanations from LLMs

Puxuan Yu, Daniel Cohen, Hemank Lamba, Joel R. Tetreault, Alejandro Jaimes

Towards Safety Reasoning in LLMs: AI-agentic Deliberation for Policy-embedded CoT Data Creation

Tharindu Kumarage, Ninareh Mehrabi, Anil Ramakrishna, Xinyan Zhao, Richard Zemel

CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation

Nengbo Wang, Xiaotian Han, Jagdip Singh, Jing Ma, Vipin Chaudhary

Financial Language Model Evaluation (FLaME)

Glenn Matlin, Mika Okamoto, Huzaifa Pardawala, Yang Yang, Sudheer Chava

BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principle

EunJeong Hwang, Peter West, Vered Shwartz

Tell, Don’t Show: Leveraging Language Models’ Abstractive Retellings to Model Literary Themes

Li Lucy, Camilla Griffiths, Sarah Levine, Jennifer L Eberhardt, Dorottya Demszky

Dynamic Knowledge Integration for Evidence-Driven Counter-Argument Generation with Large Language Models

Anar Yeginbergen, Maite Oronoz, Rodrigo Agerri

Understanding the Influence of Synthetic Data for Text Embedders

Jacob Mitchell Springer, Vaibhav Adlakha, Siva Reddy, Aditi Raghunathan, Marius Mosbach

MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notes

Asma Ben Abacha, Wen-wai Yim, Yujuan Fu, Zhaoyi Sun, Meliha Yetisgen

GUI Agents: A Survey

Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park

SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale

Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu

FastDraft: How to Train Your Draft

Ofir Zafrir, Igor Margulis, Dorin Shteyman, Shira Guskin, Guy Boudoukh

Creating a Lens of Chinese Culture: A Multimodal Dataset for Chinese Pun Rebus Art Understanding

Tuo Zhang, Tiantian Feng, Yibin Ni, Mengqin Cao, Ruying Liu

Unilogit: Robust Machine Unlearning for LLMs Using Uniform-Target Self-Distillation

Stefan Vasilev, Christian Herold, Baohao Liao, Seyyed Hadi Hashemi, Shahram Khadivi

Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processing

Neemesh Yadav, Jiarui Liu, Francesco Ortu, Roya Ensafi, Zhijing Jin

Aria-UI: Visual Grounding for GUI Instructions

Yuhao Yang, Yue Wang, DONGXU LI, Ziyang Luo, Bei Chen

Splintering Nonconcatenative Languages for Better Tokenization

Bar Gazit, Shaltiel Shmidman, Avi Shmidman, Yuval Pinter

When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits

Jabez Magomere, Emanuele La Malfa, Manuel Tonneau, Ashkan Kazemi, Scott A. Hale

A Joint Optimization Framework for Enhancing Efficiency of Tool Utilization in LLM Agents

Bin Wu, Edgar Meij, Emine Yilmaz

Toward Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST)

Jiarui Liu, Iman Ouzzani, Wenkai Li, Lechen Zhang, Tianyue Ou

CausalLink: An Interactive Evaluation Framework for Causal Reasoning

Jinyue Feng, Frank Rudzicz

Unsupervised Morphological Tree Tokenizer

Qingyang Zhu, Xiang Hu, Pengyu Ji, Wei Wu, Kewei Tu

Label-semantics Aware Generative Approach for Domain-Agnostic Multilabel Classification

Subhendu Khatuya, Shashwat Naidu, Saptarshi Ghosh, Pawan Goyal, Niloy Ganguly

Model-Dependent Moderation: Inconsistencies in Hate Speech Detection Across LLM-based Systems

Neil Fasching, Yphtach Lelkes

DPO Kernels: A Semantically-Aware, Kernel-Enhanced, and Divergence-Rich Paradigm for Direct Preference Optimization

Amitava Das, Suranjana Trivedy, Danush Khanna, Yaswanth Narsupalli, Basab Ghosh

The Structural Safety Generalization Problem

Julius Broomfield, Tom Gibbs, George Ingebretsen, Ethan Kosak-Hine, Tia Nasir

CONSENSAGENT: Towards Efficient and Effective Consensus in Multi-Agent LLM Interactions Through Sycophancy Mitigation

Priya Pitre, Naren Ramakrishnan, Xuan Wang

Heuristic-based Search Algorithm in Automatic Instruction-focused Prompt Optimization: A Survey

Wendi Cui, Jiaxin Zhang, Zhuohang Li, Hao Sun, Damien Lopez

MutantPrompt: Prompt Optimization via Mutation Under a Budget on Modest-sized LMs

Arijit Nag, Animesh Mukherjee, Niloy Ganguly, Soumen Chakrabarti

Is Large Language Model Performance on Reasoning Tasks Impacted by Different Ways Questions Are Asked?

Seok Hwan Song, Mohna Chakraborty, Qi Li, Wallapak Tavanapong

AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic

Nathaniel Romney Robinson, Shahd Abdelmoneim, Kelly Marchisio, Sebastian Ruder

Robustness and Confounders in the Demographic Alignment of LLMs with Human Perceptions of Offensiveness

Shayan Alipour, Indira Sen, Mattia Samory, Tanu Mitra

KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understanding

Ahmed Heakl, Muhammad Abdullah Sohail, Mukul Ranjan, Rania Elbadry, Ghazi Shazan Ahmad

Small Encoders Can Rival Large Decoders in Detecting Groundedness

Istabrak Abbes, Gabriele Prato, Quentin Fournier, Fernando Rodriguez, Alaa Boukhary

DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation

Wenhao Hu, Jinhao Duan, Chunchen Wei, Li Zhang, Yue Zhang

P-CoT: A Pedagogically-motivated Participatory Chain-of-Thought Prompting for Phonological Reasoning in LLMs

Dongjun Jang, Youngchae Ahn, Hyopil Shin

FanChuan: A Multilingual and Graph-Structured Benchmark For Parody Detection and Analysis

Yilun Zheng, Sha Li, Fangkun Wu, Yang Ziyi, Lin Hongchao

Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting

Hao Feng, Shu Wei, Xiang Fei, Wei Shi, Yingdong Han

TicTac: Time-aware Supervised Fine-tuning for Automatic Text Dating

Han Ren, Minna Peng

READoc: A Unified Benchmark for Realistic Document Structured Extraction

Zichao Li, Aizier Abulaiti, Yaojie Lu, Xuanang Chen, Jia Zheng

gMBA: Expression Semantic Guided Mixed Boolean-Arithmetic Deobfuscation Using Transformer Architectures

Youjeong Roh, Joon-Young Paik, Jingun Kwon, Eun-Sun Cho

Adversarial Preference Learning for Robust LLM Alignment

Yuanfu Wang, Pengyu Wang, Chenyang Xi, Bo Tang, Junyi Zhu

Brevity is the soul of sustainability: Characterizing LLM response lengths

Soham Poddar, Paramita Koley, Janardan Misra, Niloy Ganguly, Saptarshi Ghosh

Improving Occupational ISCO Classification of Multilingual Swiss Job Postings with LLM-Refined Training Data

Ann-Sophie Gnehm, Simon Clematide

Explicit Bayesian Inference to Uncover the Latent Themes of Large Language Models

Raymond Li, Chuyuan Li, Gabriel Murray, Giuseppe Carenini

Chumor 2.0: Towards Better Benchmarking Chinese Humor Understanding from (Ruo Zhi Ba)

Ruiqi He, Yushu He, Longju Bai, Jiarui Liu, Zhenjie Sun

CliniDial: A Naturally Occurring Multimodal Dialogue Dataset for Team Reflection in Action During Clinical Operation

Naihao Deng, Kapotaksha Das, Rada Mihalcea, Vitaliy Popov, Mohamed Abouelenien

Rethinking Table Instruction Tuning

Naihao Deng, Rada Mihalcea

Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation

Hoyun Song, Huije Lee, Jisu Shin, Sukmin Cho, Changgeon Ko

War of Thoughts: Competition Stimulates Stronger Reasoning in Large Language Models

Yibin Chen, Jinyi Liu, YAN ZHENG, Yifu Yuan, Jianye Hao

Is It JUST Semantics? A Case Study of Discourse Particle Understanding in LLMs

William Sheffield, Kanishka Misra, Valentina Pyatkin, Ashwini Deo, Kyle Mahowald

CARE-STaR: Constraint-aware Self-taught Reasoner

Zhiliang Li, Bo Tang, Yijun Niu, Beihong Jin, Qiwen Shi

A Reinforcement Learning Framework for Cross-Lingual Stance Detection Using Chain-of-Thought Alignment

Binghui Li, Minghui Zou, Xiaowang Zhang, Shizhan Chen, Zhiyong Feng

Towards A “Novel” Benchmark: Evaluating Literary Fiction with Large Language Models

Wenqing Wang, Mingqi Gao, Xinyu Hu, Xiaojun Wan

CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents

Tianqi Xu, Linyao Chen, Dai-Jie Wu, Yanjun Chen, Zecheng Zhang

MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification

xu Zhao Pan, Pengfei Zhou, Jiaxin Ai, Wangbo Zhao, Kai Wang

The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction

Yihuai Hong, Meng Cao, Dian Zhou, Lei Yu, Zhijing Jin

TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation Tasks

Zhou Chen, Zhiqiang Wei, Yuqi Bai, Xue Xiong, Jianmin Wu

A MISMATCHED Benchmark for Scientific Natural Language Inference

Firoz Shaik, Mobashir Sadat, Nikita Gautam, Doina Caragea, Cornelia Caragea

A Comprehensive Graph Framework for Question Answering with Mode-Seeking Preference Alignment

Quanwei Tang, Sophia Yat Mei Lee, Junshuang Wu, Dong Zhang, Shoushan Li

PEToolLLM: Towards Personalized Tool Learning in Large Language Models

Qiancheng Xu, Yongqi Li, Heming Xia, Fan LIU, Min Yang

MONTROSE: LLM-driven Monte Carlo Tree Search Self-Refinement for Cross-Domain Rumor Detection

Shanshan Liu, Menglong Lu, Zhen Huang, Zejiang He, Liu Liu

Entriever: Energy-based Retriever for Knowledge-Grounded Dialog Systems

Yucheng Cai, Ke Li, Yi Huang, Junlan Feng, Zhijian Ou

How do Transformer Embeddings Represent Compositions? A Functional Analysis

Aishik Nagar, Ishaan Singh Rawal, Mansi Dhanania, Cheston Tan

Natural Language Processing in Support of Evidence-based Medicine: A Scoping Review

Zihan Xu, Haotian Ma, Yihao Ding, Gongbo Zhang, Chunhua Weng

Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis

Yicheng Lang, kehan Guo, Yue Huang, Yujun Zhou, Haomin Zhuang

A Survey of Uncertainty Estimation Methods on Large Language Models

Zhiqiu Xia, JINXUAN XU, Yuqian Zhang, Hang Liu

Query-Driven Multimodal GraphRAG: Dynamic Local Knowledge Graph Construction for Online Reasoning

Chenyang Bu, Guojie Chang, Zihao Chen, CunYuan Dang, Zhize Wu

NOVA: An Iterative Planning Framework for Enhancing Scientific Innovation with Large Language Models

Xiang Hu, Hongyu Fu, Jinge Wang, Yifeng Wang, Zhikun Li

A Classifier of Word-Level Variants in Witnesses of Biblical Hebrew Manuscripts

Iglika Nikolova-Stoupak, Maxime Amblard, Sophie Robert-Hayek, Frédérique Rey

Synergistic Augmentation: Enhancing Cross-Domain Zero-Shot Slot Filling with Small Model-Assisted Large Language Models

Weizhen Li, Junbao Huang, Peijie Huang, Yuhong Xu, Jiekun Fan

VideoRAG: Retrieval-Augmented Generation over Video Corpus

Soyeong Jeong, Kangsan Kim, Jinheon Baek, Sung Ju Hwang

Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalization

Yilun Qiu, Xiaoyan Zhao, Yang Zhang, Yimeng Bai, Wenjie Wang

Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs

Zixiao Wang, Duzhen Zhang, Ishita Agarwal, Shen Gao, Le Song

Modal Dependency Parsing via Biaffine Attention with Self-Loop

Jayeol Chun, Nianwen Xue

Can Input Attributions Explain Inductive Reasoning in In-Context Learning?

Mengyu Ye, Tatsuki Kuribayashi, Goro Kobayashi, Jun Suzuki

Preference Curriculum: LLMs Should Always Be Pretrained on Their Preferred Data

Xuemiao Zhang, Xu Liangyu, Feiyu Duan, Yongwei Zhou, Sirui Wang

Encode Errors: Representational Retrieval of In-Context Demonstrations for Multilingual Grammatical Error Correction

Guangyue Peng, Wei Li, Wen Luo, Houfeng Wang

Diagnosing Failures in Large Language Models’ Answers: Integrating Error Attribution into Evaluation Framework

Zishan Xu, Shuyi Xie, Qingsong Lv, Shupei Xiao, Linlin Song

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment

Wen Yang, Junhong Wu, Chen Wang, Chengqing Zong, Jiajun Zhang

Evaluation of Attribution Bias in Generator-Aware Retrieval-Augmented Large Language Models

Amin Abolghasemi, Leif Azzopardi, Seyyed Hadi Hashemi, Maarten de Rijke, Suzan Verberne

Word-Level Detection of Code-Mixed Hate Speech with Multilingual Domain Transfer

Karin Niederreiter, Dagmar Gromann

How Personality Traits Shape LLM Risk-Taking Behaviour

John Hartley, Conor Brian Hamill, Dale Seddon, Devesh Batra, Ramin Okhrati

Unlocking LLMs’ Self-Improvement Capacity with Autonomous Learning for Domain Adaptation

Ke Ji, Junying Chen, Anningzhe Gao, Wenya Xie, Xiang Wan

C²RBench: A Chinese Complex Reasoning Benchmark for Large Language Models

Junru Wu, Tianhao Shen, Linxi Su, Deyi Xiong

RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-Following

Junru Lu, Jiazheng Li, Guodong Shen, Lin Gui, Siyu An

An Adaptive Multi-Threshold Loss and a General Framework for Collaborating Losses in Document-Level Relation Extraction

Huangming Xu, Fu Zhang, Jingwei Cheng

EasyEA: Large Language Model is All You Need in Entity Alignment Between Knowledge Graphs

Jingwei Cheng, Chenglong Lu, Linyan Yang, Guoqing Chen, Fu Zhang

APT: Improving Specialist LLM Performance with Weakness Case Acquisition and Iterative Preference Training

Jun Rao, Zepeng Lin, Xuebo Liu, Xiaopeng Ke, Lian Lian

Disentangling Reasoning Tokens and Boilerplate Tokens For Language Model Fine-tuning

Ziang Ye, Zhenru Zhang, Yang Zhang, Jianxin Ma, Junyang Lin

G2S: A General-to-Specific Learning Framework for Temporal Knowledge Graph Forecasting with Large Language Models

Long Bai, Zixuan Li, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

TechniqueRAG: Retrieval Augmented Generation for Adversarial Technique Annotation in Cyber Threat Intelligence Text

Ahmed Lekssays, Utsav Shukla, Husrev Taha Sencar, Md Rizwan Parvez