NAACL 2025

1,927 papers

Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness

Yoo Yeon Sung, Maharshi Gor, Eve Fleisig, Ishani Mondal, Jordan Lee Boyd-Graber

UFO: A UI-Focused Agent for Windows OS Interaction

Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao

WebQuality: A Large-scale Multi-modal Web Page Quality Assessment Dataset with Multiple Scoring Dimensions

Tao Zhang, Yige Wang, Hangyu Zhu, Xin Li, Xiang Chen

An LLM-Based Approach for Insight Generation in Data Analysis

Alberto Sánchez Pérez, Alaa Boukhary, Paolo Papotti, Luis Castejón Lozano, Adam Elwood

ALiiCE: Evaluating Positional Fine-grained Citation Generation

Yilong Xu, Jinhua Gao, Xiaoming Yu, Baolong Bi, Huawei Shen

PeerQA: A Scientific Question Answering Dataset from Peer Reviews

Tim Baumgärtner, Ted Briscoe, Iryna Gurevych

Aligning Sentence Simplification with ESL Learner’s Proficiency for Language Acquisition

Guanlin Li, Yuki Arase, Noel Crespi

MoDS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections

Nishant Balepur, Alexa Siu, Nedim Lipka, Franck Dernoncourt, Tong Sun

Fingerspelling within Sign Language Translation

Garrett Tanzer

Unlocking Decoding-time Controllability: Gradient-Free Multi-Objective Alignment with Contrastive Prompts

Tingchen Fu, Yupeng Hou, Julian McAuley, Rui Yan

PromptRefine: Enhancing Few-Shot Performance on Low-Resource Indic Languages with Example Selection from related Example Banks

Soumya Suvra Ghosal, Soumyabrata Pal, Koyel Mukherjee, Dinesh Manocha

The Impact of Visual Information in Chinese Characters: Evaluating Large Models’ Ability to Recognize and Utilize Radicals

Xiaofeng Wu, Karl Stratos, Wei Xu

LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs

Do Xuan Long, Ngoc-Hai Nguyen, Tiviatis Sim, Hieu Dao, Shafiq Joty

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems

Nandan Thakur, Suleman Kazi, Ge Luo, Jimmy Lin, Amin Ahmad

PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queries

Mingwen Dong, Nischal Ashok Kumar, Yiqun Hu, Anuj Chauhan, Chung-Wei Hang

The Russian-focused embedders’ exploration: ruMTEB benchmark and Russian embedding model design

Artem Snegirev, Maria Tikhonova, Maksimova Anna, Alena Fenogenova, Aleksandr Abramov

MAD Speech: Measures of Acoustic Diversity of Speech

Matthieu Futeral, Andrea Agostinelli, Marco Tagliasacchi, Neil Zeghidour, Eugene Kharitonov

What the #?*!: Disentangling Hate Across Target Identities

Yiping Jin, Leo Wanner, Aneesh Moideen Koya

ALTER: Augmentation for Large-Table-Based Reasoning

Han Zhang, Yuheng Ma, Hanfang Yang

Instantly Learning Preference Alignment via In-context DPO

Feifan Song, Yuxuan Fan, Xin Zhang, Peiyi Wang, Houfeng Wang

CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databases

Xiangyan Liu, Bo Lan, Zhiyuan Hu, Yang Liu, Zhicheng Zhang

Improving Retrospective Language Agents via Joint Policy Gradient Optimization

Xueyang Feng, Bo Lan, Quanyu Dai, Lei Wang, Jiakai Tang

Improving and Assessing the Fidelity of Large Language Models Alignment to Online Communities

Minh Duc Chu, Zihao He, Rebecca Dorn, Kristina Lerman

CogLM: Tracking Cognitive Development of Large Language Models

Xinglin Wang, Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Boyuan Pan

World Models with Hints of Large Language Models for Goal Achieving

Zeyuan Liu, Ziyu Huan, Xiyao Wang, Jiafei Lyu, Jian Tao

Benchmarking Distributional Alignment of Large Language Models

Nicole Meister, Carlos Guestrin, Tatsunori Hashimoto

Understanding Figurative Meaning through Explainable Visual Entailment

Arkadiy Saakyan, Shreyas Kulkarni, Tuhin Chakrabarty, Smaranda Muresan