NAACL 2025

1,927 papers

MTPChat: A Multimodal Time-Aware Persona Dataset for Conversational Agents

Wanqi Yang, Yanda Li, Meng Fang, Ling Chen

Rationale Behind Essay Scores: Enhancing S-LLM’s Multi-Trait Essay Scoring with Rationale Generated by LLMs

SeongYeub Chu, Jong Woo Kim, Bryan Wong, Mun Yong Yi

RankAdaptor: Hierarchical Rank Allocation for Efficient Fine-Tuning Pruned LLMs via Performance Model

Changhai Zhou, Shijie Han, Lining Yang, Yuhua Zhou, Xu Cheng

TabComp: A Dataset for Visual Table Reading Comprehension

Somraj Gautam, Abhishek Bhandari, Gaurav Harit

On the Role of Key Phrases in Argument Mining

Nilmadhab Das, Vijaya V Saradhi, Ashish Anand

Infogent: An Agent-Based Framework for Web Information Aggregation

Revanth Gangi Reddy, Sagnik Mukherjee, Jeonghwan Kim, Zhenhailong Wang, Dilek Hakkani-Tur

Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs

Sen Yang, Xin Li, Leyang Cui, Lidong Bing, Wai Lam

Data-centric NLP Backdoor Defense from the Lens of Memorization

Zhenting Wang, Zhizhi Wang, Mingyu Jin, Mengnan Du, Juan Zhai

Preserving Zero-shot Capability in Supervised Fine-tuning for Multi-label Text Classification

Si-An Chen, Hsuan-tien Lin, Chih-Jen Lin

LLMs are Biased Teachers: Evaluating LLM Bias in Personalized Education

Iain Weissburg, Sathvika Anand, Sharon Levy, Haewon Jeong

LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content

Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Maram Hasanain, Sahinur Rahman Laskar, Naeemul Hassan

MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning

Xujia Wang, Haiyan Zhao, Shuo Wang, Hanqing Wang, Zhiyuan Liu

Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device

Juntae Lee, Jihwan Bang, Kyuhong Shim, Seunghan Yang, Simyung Chang

Language-based Valence and Arousal Expressions between the United States and China: a Cross-Cultural Examination

Young Min Cho, Dandan Pang, Stuti Thapa, Garrick Sherman, Lyle Ungar

Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence

Qianren Mao, Weifeng Jiang, Junnan Liu, Chenghua Lin, Qian Li

Are Large Language Models Effective in Clinical Trial Design? A Study on Baseline Feature Generation

Nafis Neehal, Bowen Wang, Shayom Debopadhaya, Corey Curran, Keerthiram Murugesan

DOLFIN - Document-Level Financial Test-Set for Machine Translation

Mariam Nakhlé, Marco Dinarelli, Raheel Qader, Emmanuelle Esperança-Rodier, Hervé Blanchon

Clarify When Necessary: Resolving Ambiguity Through Interaction with LMs

Michael JQ Zhang, Eunsol Choi

MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding

Zayd Muhammad Kawakibi Zuhri, Muhammad Farid Adilazuarda, Ayu Purwarianti, Alham Fikri Aji

Constraining Sequential Model Editing with Editing Anchor Compression

Hao-Xiang Xu, Jun-Yu Ma, Zhen-Hua Ling, Ningyu Zhang, Jia-Chen Gu

Multi-Stage LLM Fine-Tuning with a Continual Learning Setting

Changhao Guan, Chao Huang, Hongliang Li, You Li, Ning Cheng

An Optimizable Suffix Is Worth A Thousand Templates: Efficient Black-box Jailbreaking without Affirmative Phrases via LLM as Optimizer

Weipeng Jiang, Zhenting Wang, Juan Zhai, Shiqing Ma, Zhengyu Zhao

BRIEF: Bridging Retrieval and Inference for Multi-hop Reasoning via Compression

Yuankai Li, Jia-Chen Gu, Di Wu, Kai-Wei Chang, Nanyun Peng

UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models

Yuzhe Yang, Yifei Zhang, Yan Hu, Yilin Guo, Ruoli Gan

ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysis

Zeao Tu, Xiangdi Meng, Yu He, Zihan Yao, Tianyu Qi

Gender Bias in Instruction-Guided Speech Synthesis Models

Chun-Yi Kuan, Hung-yi Lee

Towards Better Multi-task Learning: A Framework for Optimizing Dataset Combinations in Large Language Models

Zaifu Zhan, Rui Zhang

Transformer-based Causal Language Models Perform Clustering

Xinbo Wu, Lav R. Varshney

Where is this coming from? Making groundedness count in the evaluation of Document VQA models

Armineh Nourbakhsh, Siddharth Parekh, Pranav Shetty, Zhao Jin, Sameena Shah

Aligning to Constraints for Data-Efficient Language Model Customization

Fei Wang, Chao Shang, Shuai Wang, Sarthak Jain, Qiang Ning

From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization

Catarina G Belém, Pouya Pezeshkpour, Hayate Iso, Seiji Maekawa, Nikita Bhutani

Representation-to-Creativity (R2C): Automated Holistic Scoring Model for Essay Creativity

Deokgi Kim, Joonyoung Jo, Byung-Won On, Ingyu Lee

Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions

Yujuan Fu, Ozlem Uzuner, Meliha Yetisgen, Fei Xia

LLM-Generated Passphrases That Are Secure and Easy to Remember

Jie S. Li, Jonas Geiping, Micah Goldblum, Aniruddha Saha, Tom Goldstein

A Context-Aware Contrastive Learning Framework for Hateful Meme Detection and Segmentation

Xuanyu Su, Yansong Li, Diana Inkpen, Nathalie Japkowicz

Avoiding Copyright Infringement via Large Language Model Unlearning

Guangyao Dou, Zheyuan Liu, Qing Lyu, Kaize Ding, Eric Wong

Evaluation of Multilingual Image Captioning: How far can we get with CLIP models?

Goncalo Emanuel Cavaco Gomes, Chrysoula Zerva, Bruno Martins

On the Feasibility of In-Context Probing for Data Attribution

Cathy Jiao, Weizhen Gao, Aditi Raghunathan, Chenyan Xiong

CodeSim: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging

Md. Ashraful Islam, Mohammed Eunus Ali, Md Rizwan Parvez

MoLA: MoE LoRA with Layer-wise Expert Allocation

Chongyang Gao, Kezhen Chen, Jinmeng Rao, Ruibo Liu, Baochen Sun

Induction Heads as an Essential Mechanism for Pattern Matching in In-context Learning

Joy Crosbie, Ekaterina Shutova

OLMES: A Standard for Language Model Evaluations

Yuling Gu, Oyvind Tafjord, Bailey Kuehl, Dany Haddad, Jesse Dodge

Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias

Yuen Chen, Vethavikashini Chithrra Raghuram, Justus Mattern, Rada Mihalcea, Zhijing Jin

Playing with Voices: Tabletop Role-Playing Game Recordings as a Diarization Challenge

Lian Remme, Kevin Tang

BnTTS: Few-Shot Speaker Adaptation in Low-Resource Setting

Mohammad Jahid Ibna Basher, Md Kowsher, Md Saiful Islam, Rabindra Nath Nandi, Nusrat Jahan Prottasha

Enhancing Temporal Understanding in LLMs for Semi-structured Tables

Irwin Deng, Kushagra Dixit, Dan Roth, Vivek Gupta

Advocating Character Error Rate for Multilingual ASR Evaluation

Thennal D K, Jesin James, Deepa Padmini Gopinath, Muhammed Ashraf K

Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy

Athiya Deviyani, Fernando Diaz

Echoes of Discord: Forecasting Hater Reactions to Counterspeech

Xiaoying Song, Sharon Lisseth Perez, Xinchen Yu, Eduardo Blanco, Lingzi Hong

Jailbreaking with Universal Multi-Prompts

Yu-Ling Hsu, Hsuan Su, Shang-Tse Chen

How Inclusively do LMs Perceive Social and Moral Norms?

Michael Galarnyk, Agam Shah, Dipanwita Guhathakurta, Poojitha Nandigam, Sudheer Chava

Robust Bias Detection in MLMs and its Application to Human Trait Ratings

Ingroj Shrestha, Louis Tay, Padmini Srinivasan

A Practical Examination of AI-Generated Text Detectors for Large Language Models

Brian Tufts, Xuandong Zhao, Lei Li

Human and LLM-Based Resume Matching: An Observational Study

Swanand Vaishampayan, Hunter Leary, Yoseph Berhanu Alebachew, Louis Hickman, Brent Stevenor

WordGame: Efficient & Effective LLM Jailbreak via Simultaneous Obfuscation in Query and Response

Tianrong Zhang, Bochuan Cao, Yuanpu Cao, Lu Lin, Prasenjit Mitra

Improving Consistency in LLM Inference using Probabilistic Tokenization

Ashutosh Sathe, Divyanshu Aggarwal, Sunayana Sitaram

MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains

Guoli Yin, Haoping Bai, Shuang Ma, Feng Nan, Yanchao Sun

Decoding Fatphobia: Examining Anti-Fat and Pro-Thin Bias in AI-Generated Images

Jane Warren, Gary M. Weiss, Fernando Martinez, Annika Guo, Yijun Zhao

From Text to Emoji: How PEFT-Driven Personality Manipulation Unleashes the Emoji Potential in LLMs

Navya Jain, Zekun Wu, Cristian Enrique Munoz Villalobos, Airlie Hilliard, Xin Guan

TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data

Jipeng Zhang, Yaxuan Qin, Renjie Pi, Weizhong Zhang, Rui Pan

Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarks

Gagan Bhatia, El Moatez Billah Nagoudi, Abdellah El Mekki, Fakhraddin Alwajih, Muhammad Abdul-Mageed

Richer Output for Richer Countries: Uncovering Geographical Disparities in Generated Stories and Travel Recommendations

Kirti Bhagat, Kinshuk Vasisht, Danish Pruthi

GuideQ: Framework for Guided Questioning for progressive informational collection and classification

Priya Mishra, Suraj Racha, Kaustubh Ponkshe, Adit Akarsh, Ganesh Ramakrishnan

Beneath the Surface of Consistency: Exploring Cross-lingual Knowledge Representation Sharing in LLMs

Maxim Ifergan, Leshem Choshen, Roee Aharoni, Idan Szpektor, Omri Abend

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference

Mingqi Gao, Yixin Liu, Xinyu Hu, Xiaojun Wan, Jonathan Bragg

SFMSS: Service Flow aware Medical Scenario Simulation for Conversational Data Generation

Zhijie Bao, Qingyun Liu, Xuanjing Huang, zhongyu wei

Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models

Atharva Mehta, Shivam Chauhan, Amirbek Djanibekov, Atharva Kulkarni, Gus Xia

FinNLI: Novel Dataset for Multi-Genre Financial Natural Language Inference Benchmarking

Jabez Magomere, Elena Kochkina, Samuel Mensah, Simerjot Kaur, Charese Smiley

Lost in the Distance: Large Language Models Struggle to Capture Long-Distance Relational Knowledge

Meiyun Wang, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo

Rethinking Smoothness for Fast and Adaptable Entity Alignment Decoding

Yuanyi Wang, Han Li, Haifeng Sun, Lei Zhang, Bo He

Improving Reward Models with Synthetic Critiques

Zihuiwen Ye, Fraser David Greenlee, Max Bartolo, Phil Blunsom, Jon Ander Campos

How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models

Jiyue Jiang, Pengan CHEN, Liheng Chen, Sheng wang, Qinghang Bao

CDB: A Unified Framework for Hope Speech Detection Through Counterfactual, Desire and Belief

Tulio Ferreira Leite Da Silva, Gonzalo Freijedo Aduna, Farah Benamara, Alda Mari, Zongmin Li

A Closer Look into Mixture-of-Experts in Large Language Models

Ka Man Lo, Zeyu Huang, Zihan Qiu, Zili Wang, Jie Fu

Unified Automated Essay Scoring and Grammatical Error Correction

SeungWoo Song, Junghun Yuk, ChangSu Choi, HanGyeol Yoo, HyeonSeok Lim

RetrieverGuard: Empowering Information Retrieval to Combat LLM-Generated Misinformation

Chuwen Chen, SHUAI ZHANG

Unfolding the Headline: Iterative Self-Questioning for News Retrieval and Timeline Summarization

Weiqi Wu, Shen Huang, Yong Jiang, Pengjun Xie, Fei Huang

BitAbuse: A Dataset of Visually Perturbed Texts for Defending Phishing Attacks

Hanyong Lee, Chaelyn Lee, Yongjae Lee, Jaesung Lee

Efficient Nearest Neighbor based Uncertainty Estimation for Natural Language Processing Tasks

Wataru Hashimoto, Hidetaka Kamigaito, Taro Watanabe

Enhancing Text-to-SQL with Question Classification and Multi-Agent Collaboration

Zhihui Shao, Shubin Cai, Rongsheng Lin, Zhong Ming

TART: An Open-Source Tool-Augmented Framework for Explainable Table-based Reasoning

Xinyuan Lu, Liangming Pan, Yubo Ma, Preslav Nakov, Min-Yen Kan

How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?

Sergey Pletenev, Maria Marina, Daniil Moskovskiy, Vasily Konovalov, Pavel Braslavski

LVPruning: An Effective yet Simple Language-Guided Vision Token Pruning Approach for Multi-modal Large Language Models

Yizheng Sun, Yanze Xin, Hao Li, Jingyuan Sun, Chenghua Lin

MES-RAG: Bringing Multi-modal, Entity-Storage, and Secure Enhancements to RAG

Pingyu Wu, Daiheng Gao, Jing Tang, Huimin Chen, Wenbo Zhou

QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models

Changhai Zhou, Yuhua Zhou, Yibin Wang, Shijie Han, Qian Qiao

GPT-NER: Named Entity Recognition via Large Language Models

Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu

Effective Self-Mining of In-Context Examples for Unsupervised Machine Translation with LLMs

Abdellah El Mekki, Muhammad Abdul-Mageed

FeRG-LLM : Feature Engineering by Reason Generation Large Language Models

Jeonghyun Ko, Gyeongyun Park, Donghoon Lee, Kyunam Lee

Exploring Hybrid Sampling Inference for Aspect-based Sentiment Analysis

Xiaoyi Bao, Minjie Qiang, Jinghang Gu, Zhongqing Wang, Chu-Ren Huang

Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding

Kyungmin Min, Minbeom Kim, Kang-il Lee, Dongryeol Lee, Kyomin Jung

Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models

Haritz Puerto, Martin Gubri, Sangdoo Yun, Seong Joon Oh

Sequence-level Large Language Model Training with Contrastive Preference Optimization

Zhili Feng, Dhananjay Ram, Cole Hawkins, Aditya Rawal, Jinman Zhao

GRAG: Graph Retrieval-Augmented Generation

Yuntong Hu, Zhihan Lei, Zheng Zhang, Bo Pan, Chen Ling

VLind-Bench: Measuring Language Priors in Large Vision-Language Models

Kang-il Lee, Minbeom Kim, Seunghyun Yoon, Minsung Kim, Dongryeol Lee

MojoBench: Language Modeling and Benchmarks for Mojo

Nishat Raihan, Joanna C. S. Santos, Marcos Zampieri

Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarios

Jiwei Tang, Jin Xu, Tingwei Lu, Zhicheng Zhang, Yiming Zhao

Attention on Multiword Expressions: A Multilingual Study of BERT-based Models with Regard to Idiomaticity and Microsyntax

Iuliia Zaitova, Vitalii Hirak, Badr M. Abdullah, Dietrich Klakow, Bernd Möbius

Comprehensive Layer-wise Analysis of SSL Models for Audio Deepfake Detection

Yassine El Kheir, Younes Samih, Suraj Maharjan, Tim Polzehl, Sebastian Möller

Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding

Shulei Wang, Shuai Yang, Wang Lin, Zirun Guo, Sihang Cai

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

Peiqin Lin, Andre Martins, Hinrich Schuetze