NAACL 2025

1,927 papers

Unsupervised Speech-text word-level alignment with Dynamic Programming

Tianshu Yu, Zihan Gong, Minghuan Tan, Guhong Chen, Min Yang

Attention Tracker: Detecting Prompt Injection Attacks in LLMs

Kuo-Han Hung, Ching-Yun Ko, Ambrish Rawat, I-Hsin Chung, Winston H. Hsu

GenEOL: Harnessing the Generative Power of LLMs for Training-Free Sentence Embeddings

Raghuveer Thirukovalluru, Bhuwan Dhingra

KwaiChat: A Large-Scale Video-Driven Multilingual Mixed-Type Dialogue Corpus

Xiaoming Shi, Zeming Liu, Yiming Lei, Chenkai Zhang, Haitao Leng

“All that Glitters”: Techniques for Evaluations with Unreliable Model and Human Annotations

Michael Hardy

Test-time Backdoor Mitigation for Black-Box Large Language Models with Defensive Demonstrations

Wenjie Jacky Mo, Jiashu Xu, Qin Liu, Jiongxiao Wang, Jun Yan

DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarization

Haohan Yuan, Haopeng Zhang

Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal Nuances

Zehui Wu, Ziwei Gong, Lin Ai, Pengyuan Shi, Kaan Donbekci

Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing

Hadi Askari, Anshuman Chhabra, Muhao Chen, Prasant Mohapatra

On Using Arabic Language Dialects in Recommendation Systems

Abdulla Alshabanah, Murali Annavaram

Is Semantic Chunking Worth the Computational Cost?

Renyi Qu, Ruixuan Tu, Forrest Sheng Bao

GPT-4V Cannot Generate Radiology Reports Yet

Yuyang Jiang, Chacha Chen, Dang Nguyen, Benjamin M. Mervak, Chenhao Tan

SAFR: Neuron Redistribution for Interpretability

Ruidi Chang, Chunyuan Deng, Hanjie Chen

PuzzleGPT: Emulating Human Puzzle-Solving Ability for Time and Location Prediction

Hammad Ayyubi, Xuande Feng, Junzhang Liu, Xudong Lin, Zhecan Wang

CausalGraph2LLM: Evaluating LLMs for Causal Queries

Ivaxi Sheth, Bahare Fatemi, Mario Fritz

Evaluating the Performance of Large Language Models via Debates

Behrad Moniri, Hamed Hassani, Edgar Dobriban

UniRAG: Universal Retrieval Augmentation for Large Vision Language Models

Sahel Sharifymoghaddam, Shivani Upadhyay, Wenhu Chen, Jimmy Lin

SimSMoE: Toward Efficient Training Mixture of Experts via Solving Representational Collapse

Giang Do, Hung Le, Truyen Tran

ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Models

David Anugraha, Genta Indra Winata, Chenyue Li, Patrick Amadeus Irawan, En-Shiun Annie Lee

CAMEL-Bench: A Comprehensive Arabic LMM Benchmark

Sara Ghaboura, Ahmed Heakl, Omkar Thawakar, Ali Husain Salem Abdulla Alharthi, Ines Riahi

Can’t Hide Behind the API: Stealing Black-Box Commercial Embedding Models

Manveer Singh Tamber, Jasper Xian, Jimmy Lin

Chasing Random: Instruction Selection Strategies Fail to Generalize

Harshita Diddee, Daphne Ippolito

CaseSumm: A Large-Scale Dataset for Long-Context Summarization from U.S. Supreme Court Opinions

Mourad Heddaya, Kyle MacMillan, Hongyuan Mei, Chenhao Tan, Anup Malani

Biases in Opinion Dynamics in Multi-Agent Systems of Large Language Models: A Case Study on Funding Allocation

Pedro Cisneros-Velarde

The Geometry of Prompting: Unveiling Distinct Mechanisms of Task Adaptation in Language Models

Artem Kirsanov, Chi-Ning Chou, Kyunghyun Cho, SueYeon Chung

Open Domain Question Answering with Conflicting Contexts

Siyi Liu, Qiang Ning, Kishaloy Halder, Zheng Qi, Wei Xiao

Tomato, Tomahto, Tomate: Do Multilingual Language Models Understand Based on Subword-Level Semantic Concepts?

Crystina Zhang, Jing LU, Vinh Q. Tran, Tal Schuster, Donald Metzler

Evaluating Vision-Language Models for Emotion Recognition

Sree Bhattacharyya, James Z. Wang

RewardBench: Evaluating Reward Models for Language Modeling

Nathan Lambert, Valentina Pyatkin, Jacob Morrison, LJ Miranda, Bill Yuchen Lin

Semantic Consistency-Based Uncertainty Quantification for Factuality in Radiology Report Generation

Chenyu Wang, Weichao Zhou, Shantanu Ghosh, Kayhan Batmanghelich, Wenchao Li

PairScale: Analyzing Attitude Change with Pairwise Comparisons

Rupak Sarkar, Patrick Y. Wu, Kristina Miler, Alexander Hoyle, Philip Resnik

BioEL: A Comprehensive Python Package for Biomedical Entity Linking

Prasanth Bathala, Christophe Ye, Batuhan Nursal, Shubham Lohiya, David Kartchner

Synthetic Audio Helps for Cognitive State Tasks

Adil Soubki, John Murzaku, Peter Zeng, Owen Rambow

Data Poisoning for In-context Learning

Pengfei He, Han Xu, Yue Xing, Hui LIU, Makoto Yamada

How much do contextualized representations encode long-range context?

Simeng Sun, Cheng-Ping Hsieh

LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights cases

Santosh T.y.s.s, Isaac Misael Olguín Nolasco, Matthias Grabmair

MAiDE-up: Multilingual Deception Detection of AI-generated Hotel Reviews

Oana Ignat, Xiaomeng Xu, Rada Mihalcea

Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models

Aashiq Muhamed, Mona T. Diab, Virginia Smith

A Guide To Effectively Leveraging LLMs for Low-Resource Text Summarization: Data Augmentation and Semi-supervised Approaches

Gaurav Sahu, Olga Vechtomova, Issam H. Laradji

Does Generative AI speak Nigerian-Pidgin?: Issues about Representativeness and Bias for Multilingualism in LLMs

David Ifeoluwa Adelani, A. Seza Doğruöz, Iyanuoluwa Shode, Anuoluwapo Aremu

LVLM-Compress-Bench: Benchmarking the Broader Impact of Large Vision-Language Model Compression

Souvik Kundu, Anahita Bhiwandiwalla, Sungduk Yu, Phillip Howard, Tiep Le

From Argumentation to Deliberation: Perspectivized Stance Vectors for Fine-grained (Dis)agreement Analysis

Moritz Plenz, Philipp Heinisch, Janosch Gehring, Philipp Cimiano, Anette Frank

On the Impacts of Contexts on Repository-Level Code Generation

Nam Le Hai, Dung Manh Nguyen, Nghi D. Q. Bui

LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy

Zhiwen Ruan, Yixia Li, He Zhu, Longyue Wang, Weihua Luo

Learning to Explore and Select for Coverage-Conditioned Retrieval-Augmented Generation

Takyoung Kim, Kyungjae Lee, Young Rok Jang, Ji Yong Cho, Gangwoo Kim

Token Weighting for Long-Range Language Modeling

Falko Helm, Nico Daheim, Iryna Gurevych

AdParaphrase: Paraphrase Dataset for Analyzing Linguistic Features toward Generating Attractive Ad Texts

Soichiro Murakami, Peinan Zhang, Hidetaka Kamigaito, Hiroya Takamura, Manabu Okumura

Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Models

Yuyi Huang, Runzhe Zhan, Derek F. Wong, Lidia S. Chao, Ailin Tao

Mechanistic Unveiling of Transformer Circuits: Self-Influence as a Key to Model Reasoning

Lin Zhang, Lijie Hu, Di Wang

The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detection

Tomáš Horych, Christoph Mandl, Terry Ruas, Andre Greiner-Petter, Bela Gipp

QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online Forums

Varun Nagaraj Rao, Eesha Agarwal, Samantha Dalal, Dana Calacci, Andrés Monroy-Hernández

Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMs

Itai Mondshine, Tzuf Paz-Argaman, Reut Tsarfaty

CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmented Generation

Yiruo Cheng, Kelong Mao, Ziliang Zhao, Guanting Dong, Hongjin Qian

Obliviate: Neutralizing Task-agnostic Backdoors within the Parameter-efficient Fine-tuning Paradigm

Jaehan Kim, Minkyoo Song, Seung Ho Na, Seungwon Shin

Can Large Language Models Generate High-quality Patent Claims?

Lekang Jiang, Caiqi Zhang, Pascal A. Scherz, Stefan Goetz

Self-Training Large Language Models for Tool-Use Without Demonstrations

Ne Luo, Aryo Pradipta Gema, Xuanli He, Emile van Krieken, Pietro Lesci

In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation

Armel Randy Zebaze, Benoît Sagot, Rachel Bawden

GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge

Daniil Gurgurov, Rishu Kumar, Simon Ostermann

SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generation

Qilong Wu, Xiaoneng Xiang, Huang Hejia, Xuan Wang, Yeo Wei Jie

ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities

Jiarui Lu, Thomas Holleis, Yizhe Zhang, Bernhard Aumayer, Feng Nan

Claim-Guided Textual Backdoor Attack for Practical Applications

Minkyoo Song, Hanna Kim, Jaehan Kim, Youngjin Jin, Seungwon Shin

LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classification

Shubham Kumar Nigam, Tanmay Dubey, Govind Sharma, Noel Shallum, Kripabandhu Ghosh

Prototype Tuning: A Meta-Learning Approach for Few-Shot Document-Level Relation Extraction with Large Language Models

Dinghao Pan, Yuanyuan Sun, Bo Xu, Jiru Li, Zhihao Yang

MultiCAT: Multimodal Communication Annotations for Teams

Adarsh Pyarelal, John M Culnan, Ayesha Qamar, Meghavarshini Krishnaswamy, Yuwei Wang

RAMQA: A Unified Framework for Retrieval-Augmented Multi-Modal Question Answering

Yang Bai, Christan Grant, Daisy Zhe Wang

A Large-Scale Benchmark for Vietnamese Sentence Paraphrases

Sang Quang Nguyen, Kiet Van Nguyen

DisComp: A Two-Stage Prompt Optimization Framework Combining Task-Agnostic and Task-Aware Compression

Quancai Liu, Haihui Fan, Jinchao Zhang, Xiangfang Li, Chuanrong Li

CoPERLex: Content Planning with Event-based Representations for Legal Case Summarization

Santosh T.y.s.s, Youssef Farag, Matthias Grabmair

Understanding the Role of Mental Models in User Interaction with an Adaptive Dialog Agent

Lindsey Morgan Vanderlyn, Dirk Väth, Thang Vu

Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation

Sirui Xia, Xintao Wang, Jiaqing Liang, Yifei Zhang, Weikang Zhou

Efficient Multi-Agent Collaboration with Tool Use for Online Planning in Complex Table Question Answering

Wei Zhou, Mohsen Mesgar, Annemarie Friedrich, Heike Adel

FaithfulPersona: Balancing Faithfulness and Personalization in Code Explanations through Self-Critique

Zhuang Luo, Yichuan Li, Zexing Xu, Kyumin Lee, S. Rasoul Etesami

Pairwise Prompt-Based Tuning with Parameter Efficient Fast Adaptation for Generalized Zero-Shot Intent Detection

Xiaotong Zhang, Qianru Zhou, Han Liu, Hong Yu

LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models

Kaichen Zhang, Bo Li, Peiyuan Zhang, Fanyi Pu, Joshua Adrian Cahyono

How Do Large Language Models Perform in Dynamical System Modeling

Xiao Luo, Binqi Chen, Haixin Wang, Zhiping Xiao, Ming Zhang

Linguistically Grounded Analysis of Language Models using Shapley Head Values

Marcell Fekete, Johannes Bjerva

Dialetto, ma Quanto Dialetto? Transcribing and Evaluating Dialects on a Continuum

Ryan Soh-Eun Shim, Barbara Plank

OpenBioNER: Lightweight Open-Domain Biomedical Named Entity Recognition Through Entity Type Description

Alessio Cocchieri, Giacomo Frisoni, Marcos Martinez Galindo, Gianluca Moro, Giuseppe Tagliavini

Large-Scale Corpus Construction and Retrieval-Augmented Generation for Ancient Chinese Poetry: New Method and Data Insights

Yang Liu, Lan Lan, Jiahuan Cao, Hiuyi Cheng, Kai Ding

Towards Zero-Shot Multimodal Machine Translation

Matthieu Futeral, Cordelia Schmid, Benoît Sagot, Rachel Bawden

Tethering Broken Themes: Aligning Neural Topic Models with Labels and Authors

Mayank Nagda, Phil Ostheimer, Sophie Fellenz

Synonym-unaware Fast Adversarial Training against Textual Adversarial Attacks

Yichen Yang, Xin Liu, Kun He

Joint Learning Event-Specific Probe and Argument Library with Differential Optimization for Document-Level Multi-Event Extraction

Jianpeng Hu, Chao Xue, Chunqing Yu, Jiacheng Xu, Chengxiang Tan

Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs

Duygu Nur Yaldiz, Yavuz Faruk Bakman, Baturalp Buyukates, Chenyang Tao, Anil Ramakrishna

DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications

Sathya Krishnan Suresh, Wu Mengjun, Tushar Pranav, Eng Siong Chng

Identifying and Mitigating Social Bias Knowledge in Language Models

Ruizhe Chen, Yichen Li, Jianfei Yang, Yang Feng, Joey Tianyi Zhou

Prompt-Guided Selective Masking Loss for Context-Aware Emotive Text-to-Speech

Yejin Jeon, Youngjae Kim, Jihyun Lee, Gary Lee

Lost in Overlap: Exploring Logit-based Watermark Collision in LLMs

Yiyang Luo, Ke Lin, Chao Gu, Jiahui Hou, Lijie Wen

InstructAny2Pix: Image Editing with Multi-Modal Prompts

Shufan Li, Harkanwar Singh, Aditya Grover

SIMPLOT: Enhancing Chart Question Answering by Distilling Essentials

Wonjoong Kim, Sangwu Park, Yeonjun In, Seokwon Han, Chanyoung Park

Zero-Shot Strategies for Length-Controllable Summarization

Fabian Retkowski, Alexander Waibel

Teaching Large Language Models Number-Focused Headline Generation With Key Element Rationales

Zhen Qian, Xiuzhen Zhang, Xiaofei Xu, Feng Xia

On the Impact of Noise in Differentially Private Text Rewriting

Stephen Meisenbacher, Maulik Chevli, Florian Matthes

Multimodal Generation with Consistency Transferring

Junxiang Qiu, Jinda Lu, Shuo Wang

Adaptive Retrieval-Augmented Generation for Conversational Systems

Xi Wang, Procheta Sen, Ruizhe Li, Emine Yilmaz

Audio Description Generation in the Era of LLMs and VLMs: A Review of Transferable Generative AI Technologies

Yingqiang Gao, Lukas Fischer, Alexa Lintner, Sarah Ebling

LogRules: Enhancing Log Analysis Capability of Large Language Models through Rules

Xin Huang, Ting Zhang, Wen Zhao

CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models

Shangda Wu, Yashan Wang, Ruibin Yuan, Guo Zhancheng, Xu Tan

RELexED: Retrieval-Enhanced Legal Summarization with Exemplar Diversity

Santosh T.y.s.s, Chen Jia, Patrick Goroncy, Matthias Grabmair

DialogGen: Multi-modal Interactive Dialogue System with Multi-turn Text-Image Generation

Minbin Huang, Yanxin Long, Xinchi Deng, Ruihang Chu, Jiangfeng Xiong