EMNLP 2025

4,182 papers

GAMIC: Graph-Aligned Molecular In-context Learning for Molecule Analysis via LLMs

Ali Al Lawati, Jason S Lucas, Zhiwei Zhang, Prasenjit Mitra, Suhang Wang

Predicting Language Models’ Success at Zero-Shot Probabilistic Prediction

Kevin Ren, Santiago Cortes-Gomez, Carlos Miguel Patiño, Ananya Joshi, Ruiqi Lyu

Learning API Functionality from In-Context Demonstrations for Tool-based Agents

Bhrij Patel, Ashish Jagmohan, Aditya Vempaty

LastingBench: Defend Benchmarks Against Knowledge Leakage

Yixiong Fang, Tianran Sun, Yuling Shi, Min Wang, Xiaodong Gu

CMT-Eval: A Novel Chinese Multi-turn Dialogue Evaluation Dataset Addressing Real-world Conversational Challenges

Siyu Tian, Kaijie Mo, Yupei Wang, Renfen Hu

Probing Semantic Routing in Large Mixture-of-Expert Models

Matthew Lyle Olson, Neale Ratzlaff, Musashi Hinck, Man Luo, Sungduk Yu

Universal Acoustic Adversarial Attacks for Flexible Control of Speech-LLMs

Rao Ma, Mengjie Qian, Vyas Raina, Mark Gales, Kate Knill

LlmFixer: Fix the Helpfulness of Defensive Large Language Models

Zelong Yu, Xiaoming Zhang, Litian Zhang, Yu Yuan, Chaozhuo Li

Lemma Dilemma: On Lemma Generation Without Domain- or Language-Specific Training Data

Olia Toporkov, Alan Akbik, Rodrigo Agerri

Parallel Communities Across the Surface Web and the Dark Web

Wenchao Dong, Megha Sundriyal, Seongchan Park, Jaehong Kim, Meeyoung Cha

Skeleton-Guided-Translation: A Benchmarking Framework for Code Repository Translation with Fine-Grained Quality Evaluation

Xing Zhang, Jiaheng Wen, Fangkai Yang, Yu Kang, Pu Zhao

LegoSLM: Connecting LLM with Speech Encoder using CTC Posteriors

Rao Ma, Tongzhou Chen, Kartik Audhkhasi, Bhuvana Ramabhadran

No Free Lunch: Retrieval-Augmented Generation Undermines Fairness in LLMs, Even for Vigilant Users

Mengxuan Hu, Hongyi Wu, Ronghang Zhu, Zihan Guan, Dongliang Guo

Logic: Long-form Outline Generation via Imitative and Critical Self-refinement

Hengwei Liu, Yongliang Shen, Zhe Zheng, HaoYuan Ma, Xingyu Wu

Assess and Prompt: A Generative RL Framework for Improving Engagement in Online Mental Health Communities

Bhagesh Gaur, Karan Gupta, Aseem Srivastava, Manish Gupta, Md Shad Akhtar

FOSSIL: Harnessing Feedback on Suboptimal Samples for Data-Efficient Generalisation with Imitation Learning for Embodied Vision-and-Language Tasks

Sabrina McCallum, Amit Parekh, Alessandro Suglia

Are you sure? Measuring models bias in content moderation through uncertainty

Alessandra Urbinati, Mirko Lai, Simona Frenda, Marco Antonio Stranisci

AssistedDS: Benchmarking How External Domain Knowledge Assists LLMs in Automated Data Science

An Luo, Xun Xian, Jin Du, Fangqiao Tian, Ganghua Wang

Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models

Haonan He, Yuchen Ren, Yining Tang, Ziyang Xu, Junxian Li

LOHRec: Leveraging Order and Hierarchy in Generative Sequential Recommendation

Jiawen Xie, Haiyang Wu, Deyi Ji, Yuekui Yang, Shaoping Ma

Large Language Models as Reader for Bias Detection

Xuan Luo, Jing Li, Zhong Wenzhong, Geng Tu, Ruifeng Xu

Following Occam’s Razor: Dynamic Combination of Structured Knowledge for Multi-Hop Question Answering using LLMs

Wei Chen, Zhi Zheng, Lili Zhao, Huijun Hou, Tong Xu

Generation-Augmented Retrieval: Rethinking the Role of Large Language Models in Zero-Shot Relation Extraction

Zehan Li, Fu Zhang, Tianyue Peng, He Liu, Jingwei Cheng

Problem Solved? Information Extraction Design Space for Layout-Rich Documents using LLMs

Gaye Colakoglu, Gürkan Solmaz, Jonathan Fürst

Large Language Model Agents in Finance: A Survey Bridging Research, Practice, and Real-World Deployment

Yifei Dong, Fengyi Wu, Kunlin Zhang, Yilong Dai, Sanjian Zhang

InFact: Informativeness Alignment for Improved LLM Factuality

Roi Cohen, Russa Biswas, Gerard de Melo

A Comprehensive Survey on Learning from Rewards for Large Language Models: Reward Models and Learning Strategies

Xiaobao Wu

Linear Steerability in Language Models: When It Emerges and How It Evolves

Jianshu She, Xinyue Li, Eric P. Xing, Zhengzhong Liu, Qirong Ho

Semantic-Aware Action Space Compression via LLM-DRL Synergy for Efficient Task-oriented Dialogue Policy Exploration

Yangyang Zhao, Ben Niu, Yuxuan Tan, Shihan Wang, Libo Qin

Layer Duplication in LLMs

Neo Eyal, Nachum Dershowitz, Kfir Bar

Hierarchical Reward Modeling for Fault Localization in Large Code Repositories

Jiwei Zhang, Jianxun Lian, Haiming Qin, Mingyang Zhou, Kezhong Lu

ThinkQE: Query Expansion via an Evolving Thinking Process

Yibin Lei, Tao Shen, Andrew Yates

Semantic Component Analysis: Introducing Multi-Topic Distributions to Clustering-Based Topic Modeling

Florian Eichin, Carolin M. Schuster, Georg Groh, Michael A. Hedderich

Can Role Vectors Affect LLM Behaviour?

Daniele Potertì, Andrea Seveso, Fabio Mercorio

Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models

Runsong Zhao, Xin Liu, Xinyu Liu, Pengcheng Huang, Chunyang Xiao

ET-MIER: Entity Type-guided Key Mention Identification and Evidence Retrieval for Document-level Relation Extraction

Xin Li, Huangming Xu, Fu Zhang, Jingwei Cheng

Beneath the Facade: Probing Safety Vulnerabilities in LLMs via Auto-Generated Jailbreak Prompts

Heehyeon Kim, Kyeongryul Lee, Joyce Jiyoung Whang

Sparsifying Mamba

An Wang, Ruobing Xie, Shuaipeng Li, Xingwu Sun, Zhanhui Kang

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Hongfei Xia, Hongru Wang, Zeming Liu, Qian Yu, Yuhang Guo

Distributed LLM Serving on Consumer-Grade GPUs by Reconciling Computation and Communication

Lewei Jin, Kui Zhang, Yongqi Chen, Zhuoyifan, Renjie Li

Beyond Surface Alignment: Rebuilding LLMs Safety Mechanism via Probabilistically Ablating Refusal Direction

Yuanbo Xie, Yingjie Zhang, Tianyun Liu, Duohe Ma, Tingwen Liu

Analyzing Gambling Addictions: A Spanish Corpus for Understanding Pathological Behavior

Manuel Couto, Marcos Fernandez-Pichel, Mario Ezra Aragón, David E. Losada

Multimodal UNcommonsense: From Odd to Ordinary and Ordinary to Odd

Yejin Son, Saejin Kim, Dongjun Min, Youngjae Yu

MAFMO: Multi-modal Adaptive Fusion with Meta-template Optimization for Vision-Language Models

Mingrui Xie, Lulu Xu, Junliang Du

Representation-based Broad Hallucination Detectors Fail to Generalize Out of Distribution

Zuzanna Dubanowska, Maciej Żelaszczyk, Michał Brzozowski, Paolo Mandica, Michal P. Karpowicz

Beyond Binary Preferences: Semi-Online Label-Free GRACE-KTO with Group-Wise Adaptive Calibration for High-Quality Long-Text Generation

Jingyang Deng, Ran Chen, Jo-Ku Cheng, Jinwen Ma

A Benchmark for Hindi Verb-Argument Structure Alternations

Kanishka Jain, Ashwini Vaidya

Understanding and Improving Information Preservation in Prompt Compression for LLMs

Weronika Łajewska, Momchil Hardalov, Laura Aina, Neha Anna John, Hang Su

Transfer-Aware Data Selection for Domain Adaptation in Text Retrieval

Linzhu Yu, Huan Li, Ke Chen, Lidan Shou

Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches

Israel Abebe Azime, Deborah D. Kanubala, Tejumade Afonja, Mario Fritz, Isabel Valera

LLMs Reproduce Stereotypes of Sexual and Gender Minorities

Ruby Ostrow, Adam Lopez

QuantAgents: Towards Multi-agent Financial System via Simulated Trading

Xiangyu Li, Yawen Zeng, Xiaofen Xing, Jin Xu, Xiangmin Xu

VIVA+: Human-Centered Situational Decision-Making

Zhe Hu, Yixiao Ren, Guanzhong Liu, Jing Li, Yu Yin

KurTail : Kurtosis-based LLM Quantization

Mohammad Sadegh Akhondzadeh, Aleksandar Bojchevski, Evangelos Eleftheriou, Martino Dazzi

Investigating the Impact of Conceptual Metaphors on LLM-based NLI through Shapley Interactions

Meghdut Sengupta, Maximilian Muschalik, Fabian Fumagalli, Barbara Hammer, Eyke Hüllermeier

Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplification and Resistance in Multi-Agent Based LLM-as-Judge

Chiyu Ma, Enpei Zhang, Yilun Zhao, Wenjun Liu, Yaning Jia

Optimising Factual Consistency in Summarisation via Preference Learning from Multiple Imperfect Metrics

Yuxuan Ye, Raul Santos-Rodriguez, Edwin Simpson

Choosing a Model, Shaping a Future: Comparing LLM Perspectives on Sustainability and its Relationship with AI

Annika Bush, Meltem Aksoy, Markus Pauly, Greta Ontrup

Ko-LongRAG: A Korean Long-Context RAG Benchmark Built with a Retrieval-Free Approach

Yongil Kim, Heuiyeen Yeen, Hyeongu Yun, Jinsik Lee

PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions

Song Dai, Yibo Yan, Jiamin Su, Zihao Dongfang, Yubo Gao

Diving into Mitigating Hallucinations from a Vision Perspective for Large Vision-Language Models

Weihang Wang, Xinhao Li, Ziyue Wang, Yan Pang, Jielei Zhang

Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses

Yishan Wang, Amanda Cercas Curry, Flor Miriam Plaza-del-Arco

Low-Hallucination and Efficient Coreference Resolution with LLMs

Yujian Gan, Yuan Liang, Jinxia Xie, Yanni Lin, Juntao Yu

URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models

Ruiqi Yan, Xiquan Li, Wenxi Chen, Zhikang Niu, chen yang

PolBiX: Detecting LLMs’ Political Bias in Fact-Checking through X-phemisms

Charlott Jakob, David Harbecke, Patrick Parschan, Pia Wenzel Neves, Vera Schmitt

Tracing Training Footprints: A Calibration Approach for Membership Inference Attacks Against Multimodal Large Language Models

Xiaofan Zheng, Huixuan Zhang, Xiaojun Wan

Distilling Many-Shot In-Context Learning into a Cheat Sheet

Ukyo Honda, Soichiro Murakami, Peinan Zhang

Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models

Zonghao Ying, Deyue Zhang, Zonglei Jing, Yisong Xiao, Quanchen Zou

Faster and Better LLMs via Latency-Aware Test-Time Scaling

Zili Wang, Tianyu Zhang, Haoli Bai, Lu Hou, Xianzhi Yu

ConciseRL: Conciseness-Guided Reinforcement Learning for Efficient Reasoning Models

Razvan-Gabriel Dumitru, Darius Peteleaza, Vikas Yadav, Liangming Pan

Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study

Yujun Zhou, Jiayi Ye, Zipeng Ling, Yufei Han, Yue Huang

Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agents

Shouju Wang, Fenglin Yu, Xirui Liu, Xiaoting Qin, Jue Zhang

Zero-shot Graph Reasoning via Retrieval Augmented Framework with LLMs

Hanqing Li, Sharika Mahadevan, Kiran Jyothi Sheena, Henry Liang, Diego Klabjan

IP-Dialog: Evaluating Implicit Personalization in Dialogue Systems with Synthetic Data

Bo Peng, Zhiheng Wang, Heyang Gong, Chaochao Lu

On Guardrail Models’ Robustness to Mutations and Adversarial Attacks

Elias Bassani, Ignacio Sanchez

Semantic Contribution-Aware Adaptive Retrieval for Black-Box Models

Qinhong Lin, Zhongliang Yang, Yuang Cai, Dingfu Yu, Xuan Xu

Does Visual Grounding Enhance the Understanding of Embodied Knowledge in Large Language Models?

Zhihui Yang, Yupei Wang, Kaijie Mo, Zhe Zhao, Renfen Hu

StandUp4AI: A New Multilingual Dataset for Humor Detection in Stand-up Comedy Videos

Valentin Barriere, Nahuel Gomez, Léo Hemamou, Sofia Callejas, Brian Ravenet

MONAQ: Multi-Objective Neural Architecture Querying for Time-Series Analysis on Resource-Constrained Devices

Patara Trirat, Jae-Gil Lee

MASTER: Multi-Agent Security Through Exploration of Roles and Topological Structures - A Comprehensive Framework

Yifan Zhu, Chao Zhang, Xin Shi, Xueqiao Zhang, Yi Yang

When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning

Yijiang River Dong, Tiancheng Hu, Yinhong Liu, Ahmet Üstün, Nigel Collier

Dynamic Injection of Entity Knowledge into Dense Retrievers

Ikuya Yamada, Ryokan Ri, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo

FAEDKV: Infinite-Window Fourier Transform for Unbiased KV Cache Compression

Runchao Li, Yao Fu, Mu Sheng, Xianxuan Long, Haotian Yu

EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models

Abhay Gupta, Jacob Cheung, Philip Meng, Shayan Sayyed, Kevin Zhu

Self-adaptive Dataset Construction for Real-World Multimodal Safety Scenarios

Jingen Qu, Lijun Li, Bo Zhang, Yichen Yan, Jing Shao

FoodSafeSum: Enabling Natural Language Processing Applications for Food Safety Document Summarization and Analysis

Juli Bakagianni, Korbinian Randl, Guido Rocchietti, Cosimo Rulli, Franco Maria Nardini

Assessing the Sensitivity and Alignment of FOL Closeness Metrics

Ramya Keerthy Thatikonda, Wray Buntine, Ehsan Shareghi

BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models

Xu Huang, Wenhao Zhu, Hanxu Hu, Conghui He, Lei Li

FinLFQA: Evaluating Attributed Text Generation of LLMs in Financial Long-Form Question Answering

Yitao Long, Tiansheng Hu, Yilun Zhao, Arman Cohan, Chen Zhao

Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems

Qian Xiong, Yuekai Huang, Ziyou Jiang, Zhiyuan Chang, Yujia Zheng

M-Ped: Multi-Prompt Ensemble Decoding for Large Language Models

Jiaxin Guo, Daimeng Wei, Yuanchang Luo, Hengchao Shang, Zongyao Li

DecisionFlow: Advancing Large Language Model as Principled Decision Maker

Xiusi Chen, Shanyong Wang, Cheng Qian, Hongru Wang, Peixuan Han

Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics

Sheldon Yu, Yuxin Xiong, Junda Wu, Xintong Li, Tong Yu

Annotation-Efficient Language Model Alignment via Diverse and Representative Response Texts

Yuu Jinnai, Ukyo Honda

Self-Ensemble: Mitigating Confidence Distortion for Large Language Models

Zicheng Xu, Guanchu Wang, Guangyao Zheng, Yu-Neng Chuang, Alex Szalay

Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model Merging

Hua Farn, Hsuan Su, Shachi H. Kumar, Saurav Sahay, Shang-Tse Chen

PATIMT-Bench: A Multi-Scenario Benchmark for Position-Aware Text Image Machine Translation in Large Vision-Language Models

Wanru Zhuang, Wenbo Li, Zhibin Lan, Xu Han, Peng Li

FigEx: Aligned Extraction of Scientific Figures and Captions

Jifeng Song, Arun Das, Ge Cui, Yufei Huang

SeaPO: Strategic Error Amplification for Robust Preference Optimization of Large Language Models

Jun Rao, Yunjie Liao, Xuebo Liu, Zepeng Lin, Lian Lian

FormosanBench: Benchmarking Low-Resource Austronesian Languages in the Era of Large Language Models

Kaiying Kevin Lin, Hsi-Yu Chen, Haopeng Zhang