ACL 2025

4,141 papers

V-ALPHASOCIAL: Benchmark and Self-Reflective Chain-of-Thought Generation for Visual Social Commonsense Reasoning

Zongyu Lin, Zhikun Xu, Xiaohan Song, Yixin Wan, Xingcheng Yao

Mitigating Bias in RAG: Controlling the Embedder

Taeyoun Kim, Jacob Mitchell Springer, Aditi Raghunathan, Maarten Sap

Conservative Bias in Large Language Models: Measuring Relation Predictions

Toyin Aguda, Erik Wilson, Allan Anzagira, Simerjot Kaur, Charese Smiley

TReMu: Towards Neuro-Symbolic Temporal Reasoning for LLM-Agents with Memory in Multi-Session Dialogues

Yubin Ge, Salvatore Romeo, Jason Cai, Raphael Shu, Yassine Benajiba

Systematic Evaluation of Auto-Encoding and Large Language Model Representations for Capturing Author States and Traits

Khushboo Singh, Vasudha Varadarajan, Adithya V. Ganesan, August Håkan Nilsson, Nikita Soni

Speech Act Patterns for Improving Generalizability of Explainable Politeness Detection Models

Ahmad Aljanaideh

The Lies Characters Tell: Utilizing Large Language Models to Normalize Adversarial Unicode Perturbations

Portia Cooper, Eduardo Blanco, Mihai Surdeanu

Let The Jury Decide: Fair Demonstration Selection for In-Context Learning through Incremental Greedy Evaluation

Sadaf Md Halim, Chen Zhao, Xintao Wu, Latifur Khan, Christan Grant

MedCite: Can Language Models Generate Verifiable Text for Medicine?

Xiao Wang, Mengjue Tan, Qiao Jin, Guangzhi Xiong, YU HU

A Multi-Labeled Dataset for Indonesian Discourse: Examining Toxicity, Polarization, and Demographics Information

Lucky Susanto, Musa Izzanardi Wijanarko, Prasetia Anugrah Pratama, Zilu Tang, Fariz Akyas

Vision-Language Models Struggle to Align Entities across Modalities

Iñigo Alonso, Gorka Azkune, Ander Salaberria, Jeremy Barnes, Oier Lopez de Lacalle

Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models

Qianqi Yan, Yue Fan, Hongquan Li, Shan Jiang, Yang Zhao

MVTamperBench: Evaluating Robustness of Vision-Language Models

Amit Agarwal, Srikant Panda, Angeline Charles, Hitesh Laxmichand Patel, Bhargava Kumar

MetaSynth: Meta-Prompting-Driven Agentic Scaffolds for Diverse Synthetic Data Generation

Haris Riaz, Sourav Sanjukta Bhabesh, Vinayak Arannil, Miguel Ballesteros, Graham Horwood

Is a cute puyfred cute? Context-dependent form-meaning systematicity in LLMs

Jaïr A. Waal, Giovanni Cassani

Safety is Not Only About Refusal: Reasoning-Enhanced Fine-tuning for Interpretable LLM Safety

Yuyou Zhang, Miao Li, William Han, Yihang Yao, Zhepeng Cen

Privacy Ripple Effects from Adding or Removing Personal Information in Language Model Training

Jaydeep Borkar, Matthew Jagielski, Katherine Lee, Niloofar Mireshghallah, David A. Smith

MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs

Kaustubh Deshpande, Ved Sirdeshmukh, Johannes Baptist Mols, Lifeng Jin, Ed-Yeremai Hernandez-Cardona

Can Multimodal Foundation Models Understand Schematic Diagrams? An Empirical Study on Information-Seeking QA over Scientific Papers

Yilun Zhao, Chengye Wang, Chuhan Li, Arman Cohan

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models

Yingqian Cui, Pengfei He, Jingying Zeng, Hui LIU, Xianfeng Tang

Biases Propagate in Encoder-based Vision-Language Models: A Systematic Analysis From Intrinsic Measures to Zero-shot Retrieval Outcomes

Kshitish Ghate, Tessa Charlesworth, Mona T. Diab, Aylin Caliskan

Trick or Neat: Adversarial Ambiguity and Language Model Evaluation

Antonia Karamolegkou, Oliver Eberle, Phillip Rust, Carina Kauf, Anders Søgaard

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing

Ming Cheng, Jiaying Gong, Hoda Eldardiry

MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference

Akshat Sharma, Hangliang Ding, Jianping Li, Neel Dani, Minjia Zhang

Machine Theory of Mind Needs Machine Validation

Adil Soubki, Owen Rambow

Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering

Francesco Maria Molfese, Luca Moroni, Luca Gioffré, Alessandro Scirè, Simone Conia

A General Framework to Enhance Fine-tuning-based LLM Unlearning

Jie Ren, Zhenwei Dai, Xianfeng Tang, Hui LIU, Jingying Zeng

Mind the (Belief) Gap: Group Identity in the World of LLMs

Angana Borah, Marwa Houalla, Rada Mihalcea

Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems

Emma Harvey, Emily Sheng, Su Lin Blodgett, Alexandra Chouldechova, Jean Garcia-Gathright

Same Company, Same Signal: The Role of Identity in Earnings Call Transcripts

Ding Yu, Zhuo Liu, Hangfeng He

VISIAR: Empower MLLM for Visual Story Ideation

Zhaoyang Xia, Somdeb Sarkhel, Mehrab Tanjim, Stefano Petrangeli, Ishita Dasgupta

Asymmetric Conflict and Synergy in Post-training for LLM-based Multilingual Machine Translation

Tong Zheng, Yan Wen, Huiwen Bao, Junfeng Guo, Heng Huang

FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point

Ke Yi, Jianwei Zhang, Zhiying Xu, Xinlong Yang, Yang Zhou

Fact Recall, Heuristics or Pure Guesswork? Precise Interpretations of Language Models for Fact Completion

Denitsa Saynova, Lovisa Hagström, Moa Johansson, Richard Johansson, Marco Kuhlmann

Mixture of Structural-and-Textual Retrieval over Text-rich Graph Knowledge Bases

Yongjia Lei, Haoyu Han, Ryan A. Rossi, Franck Dernoncourt, Nedim Lipka

PreSumm: Predicting Summarization Performance Without Summarizing

Steven Koniaev, Ori Ernst, Jackie CK Cheung

Recursive Question Understanding for Complex Question Answering over Heterogeneous Personal Data

Philipp Christmann, Gerhard Weikum

Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents

Chaoran Chen, Bingsheng Yao, Ruishi Zou, Wenyue Hua, Weimin Lyu

Going Beyond Your Expectations in Latency Metrics for Simultaneous Speech Translation

Jorge Iranzo-Sánchez, Javier Iranzo-Sánchez, Adrià Giménez, Jorge Civera

Speculative Sampling via Exponential Races

Szymon Kobus, Deniz Gündüz

PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Models

Xueliang Zhao, Wei Wu, Jian Guan, Lingpeng Kong

Smotrom tvoja på ander drogoj verden! Resurrecting Dead Pidgin with Generative Models: Russenorsk Case Study

Alexey Tikhonov, Sergei Shteiner, Anna Bykova, Ivan P. Yamshchikov

A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models

Shuliang Liu, Hongyi Liu, Aiwei Liu, Duan Bingchen, Zheng Qi

ShieldHead: Decoding-time Safeguard for Large Language Models

Zitao Xuan, Xiaofeng Mao, Da Chen, Xin Zhang, Yuhan Dong

The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks

Benedikt Ebing, Goran Glavaš

Process-based Self-Rewarding Language Models

Shimao Zhang, Xiao Liu, Xin Zhang, Junxiao Liu, Zheheng Luo

FactLens: Benchmarking Fine-Grained Fact Verification

Kushan Mitra, Dan Zhang, Sajjadur Rahman, Estevam Hruschka

iAgent: LLM Agent as a Shield between User and Recommender Systems

Wujiang Xu, Yunxiao Shi, Zujie Liang, Xuying Ning, Kai Mei

PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistants

Zheng Zhao, Clara Vania, Subhradeep Kayal, Naila Khan, Shay B Cohen

Exploring Supervised Approaches to the Detection of Anthropomorphic Language in the Reporting of NLP Venues

Matthew Shardlow, Ashley Williams, Charlie Roadhouse, Filippos Ventirozos, Piotr Przybyła

Benchmarking the Benchmarks: Reproducing Climate-Related NLP Tasks

Tom Calamai, Oana Balalau, Fabian M. Suchanek

BEDAA: Bayesian Enhanced DeBERTa for Uncertainty-Aware Authorship Attribution

Iqra Zahid, Youcheng Sun, Riza Batista-Navarro

On the Generalization vs Fidelity Paradox in Knowledge Distillation

Suhas Kamasetty Ramesh, Ayan Sengupta, Tanmoy Chakraborty

Annotating the Annotators: Analysis, Insights and Modelling from an Annotation Campaign on Persuasion Techniques Detection

Davide Bassi, Dimitar Iliyanov Dimitrov, Bernardo D’Auria, Firoj Alam, Maram Hasanain

Generative Frame Sampler for Long Video Understanding

Linli Yao, Haoning Wu, Kun Ouyang, Yuanxing Zhang, Caiming Xiong

JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse

Muyao Li, Zihao Wang, Kaichen He, Xiaojian Ma, Yitao Liang

Transparentize the Internal and External Knowledge Utilization in LLMs with Trustworthy Citation

Jiajun Shen, Tong Zhou, Yubo Chen, Delai Qiu, Shengping Liu

Sign2Vis: Automated Data Visualization from Sign Language

Yao Wan, Yang Wu, Zhen Li, Guobiao Zhang, Hongyu Zhang

C2KD: Cross-layer and Cross-head Knowledge Distillation for Small Language Model-based Recommendation

Xiao Chen, Changyi Ma, Wenqi Fan, Zhaoxiang Zhang, Li Qing

LLM Agents for Coordinating Multi-User Information Gathering

Harsh Jhamtani, Jacob Andreas, Benjamin Van Durme

BenNumEval: A Benchmark to Assess LLMs’ Numerical Reasoning Capabilities in Bengali

Kawsar Ahmed, Md Osama, Omar Sharif, Eftekhar Hossain, Mohammed Moshiul Hoque

What is in a name? Mitigating Name Bias in Text Embedding Similarity via Anonymization

Sahil Manchanda, Pannaga Shivaswamy

Open-World Authorship Attribution

Xinhao Tan, Songhua Liu, Xia Cong, Kunjun Li, Xinchao Wang

Code-SPA: Style Preference Alignment to Large Language Models for Effective and Robust Code Debugging

Tengfei Wen, Xuanang Chen, Ben He, Le Sun

Tag-Instruct: Controlled Instruction Complexity Enhancement through Structure-based Augmentation

He Zhu, Zhiwen Ruan, Junyou Su, Xingwei He, Yun Chen

Hatevolution: What Static Benchmarks Don’t Tell Us

Chiara Di Bonaventura, Barbara McGillivray, Yulan He, Albert Meroño-Peñuela

Look & Mark: Leveraging Radiologist Eye Fixations and Bounding boxes in Multimodal Large Language Models for Chest X-ray Report Generation

Yunsoo Kim, Jinge Wu, Su Hwan Kim, Pardeep Vasudev, Jiashu Shen

Multi-Hop Reasoning for Question Answering with Hyperbolic Representations

Simon Welz, Lucie Flek, Akbar Karimi

JEBS: A Fine-grained Biomedical Lexical Simplification Task

William Xia, Ishita Unde, Brian David Ondov, Dina Demner-Fushman

FANNO: Augmenting High-Quality Instruction Data with Open-Sourced LLMs Only

He Zhu, Yifan Ding, Yicheng Tao, Zhiwen Ruan, Yixia Li

Are Your LLMs Capable of Stable Reasoning?

Junnan Liu, Hongwei Liu, Linchen Xiao, Ziyi Wang, Kuikun Liu

Multimodal Fusion and Coherence Modeling for Video Topic Segmentation

Hai Yu, Chong Deng, Qinglin Zhang, Jiaqing Liu, Qian Chen

100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability?

Van Yang, Hongye Jin, Shaochen Zhong, Song Jiang, Qifan Wang

Each graph is a new language: Graph Learning with LLMs

Huachi Zhou, Jiahe Du, Chuang Zhou, Chang Yang, Yilin Xiao

Bridging Intuitive Associations and Deliberate Recall: Empowering LLM Personal Assistant with Graph-Structured Long-term Memory

Yujie Zhang, Weikang Yuan, Zhuoren Jiang

ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generation

Alireza Salemi, Julian Killingback, Hamed Zamani

AskQE: Question Answering as Automatic Evaluation for Machine Translation

Dayeon Ki, Kevin Duh, Marine Carpuat

Metaphor and Large Language Models: When Surface Features Matter More than Deep Understanding

Elisa Sanchez-Bayona, Rodrigo Agerri

Visualising Policy-Reward Interplay to Inform Zeroth-Order Preference Optimisation of Large Language Models

Alessio Galatolo, Zhenbang Dai, Katie Winkle, Meriem Beloucif

MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency

Junzhe Zhang, Huixuan Zhang, Xunjian Yin, Baizhou Huang, Xu Zhang

Nested-Refinement Metamorphosis: Reflective Evolution for Efficient Optimization of Networking Problems

Shuhan Guo, Nan Yin, James Kwok, Quanming Yao

R.R.: Unveiling LLM Training Privacy through Recollection and Ranking

Wenlong Meng, Guo Zhenyuan, Lenan Wu, Chen Gong, Wenyan Liu

Natural Logic at the Core: Dynamic Rewards for Entailment Tree Generation

Jihao Shi, Xiao Ding, Kai Xiong, Hengwei Zhao, Bing Qin

Are Dialects Better Prompters? A Case Study on Arabic Subjective Text Classification

Leila Moudjari, Farah Benamara

ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models

Martina Miliani, Serena Auriemma, Alessandro Bondielli, Emmanuele Chersoni, Lucia Passaro

Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMs

Omar Momen, Manuel Schaaf, Alexander Mehler

Stereotype Detection as a Catalyst for Enhanced Bias Detection: A Multi-Task Learning Approach

Aditya Tomar, Rudra Murthy, Pushpak Bhattacharyya

Libra: Leveraging Temporal Images for Biomedical Radiology Analysis

Xi Zhang, Zaiqiao Meng, Jake Lever, Edmond S. L. Ho

A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences

Jiaxin Shen, Jinan Xu, Huiqi Hu, Luyi Lin, Guoyang Ma

EMRs2CSP : Mining Clinical Status Pathway from Electronic Medical Records

Yifei Chen, Ruihui Hou, Jingping Liu, Tong Ruan

Beyond the Tip of Efficiency: Uncovering the Submerged Threats of Jailbreak Attacks in Small Language Models

Sibo Yi, Tianshuo Cong, Xinlei He, Qi Li, Jiaxing Song

Who Can Withstand Chat-Audio Attacks? An Evaluation Benchmark for Large Audio-Language Models

Wanqi Yang, Yanda Li, Meng Fang, Yunchao Wei, Ling Chen

Navigating the Political Compass: Evaluating Multilingual LLMs across Languages and Nationalities

Chadi Helwe, Oana Balalau, Davide Ceolin

In the LLM era, Word Sense Induction remains unsolved

Anna Mosolova, Marie Candito, Carlos Ramisch

FADE: Why Bad Descriptions Happen to Good Features

Bruno Puri, Aakriti Jain, Elena Golimblevskaia, Patrick Kahardipraja, Thomas Wiegand

VP-MEL: Visual Prompts Guided Multimodal Entity Linking

Hongze Mi, Jinyuan Li, Xuying Zhang, Haoran Cheng, Jiahao Wang

PAM: Paraphrase AMR-Centric Evaluation Metric

Afonso Sousa, Henrique Lopes Cardoso

Generate, Discriminate, Evolve: Enhancing Context Faithfulness via Fine-Grained Sentence-Level Self-Evolution

Kun Li, Tianhua Zhang, Yunxiang Li, Hongyin Luo, Abdalla Mohamed Salama Sayed Moustafa

RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment

Zhuoran jin, Hongbang Yuan, Tianyi Men, Pengfei Cao, Yubo Chen

Change Entity-guided Heterogeneous Representation Disentangling for Change Captioning

Yi Li, Yunbin Tu, Liang Li, Li Su, Qingming Huang