Skip to content
conftrace_

ACL 2025

4,141 papers

On the Way to LLM Personalization: Learning to Remember User Conversations

Lucie Charlotte Magister, Katherine Metcalf, Yizhe Zhang, Maartje Ter Hoeve

Towards a Principled Evaluation of Knowledge Editors

Sebastian Pohl, Max Ploner, Alan Akbik

From Data to Knowledge: Evaluating How Efficiently Language Models Learn Facts

Daniel Christoph, Max Ploner, Patrick Haller, Alan Akbik

Memorization in Language Models through the Lens of Intrinsic Dimension

Stefan Arnold

Factual Knowledge in Language Models: Robustness and Anomalies under Simple Temporal Context Variations

Hichem Ammar Khodja, Frédéric Béchet, Quentin Brabant, Alexis Nasr, Gwénolé Lecorvé

Superfluous Instruction: Vulnerabilities Stemming from Task-Specific Superficial Expressions in Instruction Templates

Toma Suzuki, Yusuke Sakai, Justin Vasselli, Hidetaka Kamigaito, Taro Watanabe

Reasoning or Memorization? Investigating LLMs’ Capability in Restoring Chinese Internet Homophones

Jianfei Ma, Zhaoxin Feng, Huacheng Song, Emmanuele Chersoni, Zheng Chen

Theorem-of-Thought: A Multi-Agent Framework for Abductive, Deductive, and Inductive Reasoning in Language Models

Samir Abdaljalil, Hasan Kurban, Khalid Qaraqe, Erchin Serpedin

Meetalk: Retrieval-Augmented and Adaptively Personalized Meeting Summarization with Knowledge Learning from User Corrections

Zheng Chen, Jiang Futian, Yue Deng, Changyang He, Bo Li

Can LLMs Recognize Their Own Analogical Hallucinations? Evaluating Uncertainty Estimation for Analogical Reasoning

Zheng Chen, Zhaoxin Feng, Jianfei Ma, Jiexi Xu, Bo Li

ToolReAGt: Tool Retrieval for LLM-based Complex Task Solution via Retrieval Augmented Generation

Norbert Braunschweiler, Rama Doddipatla, Tudor-catalin Zorila

MLAN: Language-Based Instruction Tuning Preserves and Transfers Knowledge in Multimodal Language Models

Jianhong Tu, Zhuohao Ni, Nicholas Crispino, Zihao Yu, Michael Bendersky

Stress-Testing Multimodal Foundation Models for Crystallographic Reasoning

Can Polat, Hasan Kurban, Erchin Serpedin, Mustafa Kurban

Knowledge-Grounded Detection of Cryptocurrency Scams with Retrieval-Augmented LMs

Zichao Li

Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals

Lida Chen, Zujie Liang, Xintao Wang, Jiaqing Liang, Yanghua Xiao

EdTec-ItemGen: Enhancing Retrieval-Augmented Item Generation Through Key Point Extraction

Alonso Palomino, David Buschhüter, Roland Roller, Niels Pinkwart, Benjamin Paassen

Temporal Information Retrieval via Time-Specifier Model Merging

SeungYoon Han, Taeho Hwang, Sukmin Cho, Soyeong Jeong, Hoyun Song

Findings of the IWSLT 2025 Evaluation Campaign

Idris Abdulmumin, Victor Agostinelli, Tanel Alumäe, Antonios Anastasopoulos, Luisa Bentivogli

HITSZ’s End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Track

Xuchen Wei, Yangxin Wu, Yaoyin Zhang, Henglyu Liu, Kehai Chen

Effectively combining Phi-4 and NLLB for Spoken Language Translation: SPRING Lab IITM’s submission to Low Resource Multilingual Indic Track

Sankalpa Sarkar, Samriddhi Kashyap, Advait Joglekar, Srinivasan Umesh

Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025

Dominik Macháček, Peter Polák

Efficient Speech Translation through Model Compression and Knowledge Distillation

Yasmin Moslem

NAIST Simultaneous Speech Translation System for IWSLT 2025

Haotian Tan, Ruhiyah Faradishi Widiaputri, Jan Meyer Saragih, Yuka Ko, Katsuhito Sudoh

NAIST Offline Speech Translation System for IWSLT 2025

Ruhiyah Faradishi Widiaputri, Haotian Tan, Jan Meyer Saragih, Yuka Ko, Katsuhito Sudoh

Bemba Speech Translation: Exploring a Low-Resource African Language

Muhammad Hazim Al Farouq, Aman Kassahun Wassie, Yasmin Moslem

Instituto de Telecomunicações at IWSLT 2025: Aligning Small-Scale Speech and Language Models for Speech-to-Text Learning

Giuseppe Attanasio, Sonal Sannigrahi, Ben Peters, André F. T. Martins

MLLP-VRAIN UPV system for the IWSLT 2025 Simultaneous Speech Translation Translation task

Jorge Iranzo-Sánchez, Javier Iranzo-Sánchez, Adrià Giménez Pastor, Jorge Civera Saiz, Alfons Juan

IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation

Bhavana Akkiraju, Aishwarya Pothula, Santosh Kesiraju, Anil Vuppala

SYSTRAN @ IWSLT 2025 Low-resource track

Marko Avila, Josep Crego

JHU IWSLT 2025 Low-resource System Description

Nathaniel Romney Robinson, Niyati Bafna, Xiluo He, Tom Lupicki, Lavanya Shankar

CMU’s IWSLT 2025 Simultaneous Speech Translation System

Siqi Ouyang, Xi Xu, Lei Li

BeaverTalk: Oregon State University’s IWSLT 2025 Simultaneous Speech Translation System

Matthew Raffel, Victor Agostinelli III, Lizhong Chen

GMU Systems for the IWSLT 2025 Low-Resource Speech Translation Shared Task

Chutong Meng, Antonios Anastasopoulos

CUNI-NL@IWSLT 2025: End-to-end Offline Speech Translation and Instruction Following with LLMs

Nam Luu, Ondřej Bojar

LIA and ELYADATA systems for the IWSLT 2025 low-resource speech translation shared task

Chaimae Chellaf, Haroun Elleuch, Othman Istaiteh, D. Fortuné KPONOU, Fethi Bougares

BUINUS at IWSLT: Evaluating the Impact of Data Augmentation and QLoRA-based Fine-Tuning for Maltese to English Speech Translation

Filbert Aurelian Tjiaranata, Vallerie Alexandra Putra, Eryawan Presma Yulianrifat, Ikhlasul Akmal Hanif

QUESPA Submission for the IWSLT 2025 Dialectal and Low-resource Speech Translation Task

John E. Ortega, Rodolfo Joel Zevallos, William Chen, Idris Abdulmumin

ALADAN at IWSLT25 Low-resource Arabic Dialectal Speech Translation Task

Josef Jon, Waad Ben Kheder, André Beyer, Claude Barras, Jean-Luc Gauvain

IWSLT 2025 Indic Track System Description Paper: Speech-to-Text Translation from Low-Resource Indian Languages (Bengali and Tamil) to English

Sayan Das, Soham Chaudhuri, Dipanjan Saha, Dipankar Das, Sivaji Bandyopadhyay

KIT’s Offline Speech Translation and Instruction Following Submission for IWSLT 2025

Sai Koneru, Maike Züfle, Thai Binh Nguyen, Seymanur Akti, Jan Niehues

AppTek’s Automatic Speech Translation: Generating Accurate and Well-Readable Subtitles

Frithjof Petrick, Patrick Wilken, Evgeny Matusov, Nahuel Unai Roselló Beneitez, Sarah Beranek

KIT’s Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization

Zhaolin Li, Yining Liu, Danni Liu, Tuan Nam Nguyen, Enes Yavuz Ugan

NYA’s Offline Speech Translation System for IWSLT 2025

Wenxuan Wang, Yingxin Zhang, Yifan Jin, Binbin Du, Yuke Li

JU-CSE-NLP’s Cascaded Speech to Text Translation Systems for IWSLT 2025 in Indic Track

Debjit Dhar, Soham Lahiri, Tapabrata Mondal, Sivaji Bandyopadhyay

NAVER LABS Europe Submission to the Instruction-following Track

Beomseok Lee, Marcely Zanon Boito, Laurent Besacier, Ioan Calapodescu

CDAC-SVNIT submission for IWSLT 2025 Indic track shared task

Mukund K. Roy, Karunesh Arora, Praveen Kumar Chandaliya, Rohit Kumar, Pruthwik Mishra

Swiss German Speech Translation and the Curse of Multidialectality

Martin Bär, Andrea DeMarco, Gorka Labaka

HENT-SRT: Hierarchical Efficient Neural Transducer with Self-Distillation for Joint Speech Recognition and Translation

Amir Hussein, Cihan Xiao, Matthew Wiesner, Dan Povey, Leibny Paola Garcia

FFSTC 2: Extending the Fongbe to French Speech Translation Corpus

D. Fortuné KPONOU, Salima Mdhaffar, Fréjus A. A. Laleye, Eugène Cokou Ezin, Yannick Estève

Human-Evaluated Urdu-English Speech Corpus: Advancing Speech-to-Text for Low-Resource Languages

Humaira Mehmood, Sadaf Abdul Rauf

Prompting LLMs: Length Control for Isometric Machine Translation

Dávid Javorský, Ondřej Bojar, François Yvon

Literary Translations and Synthetic Data for Machine Translation of Low-resourced Middle Eastern Languages

Sina Ahmadi, Razhan Hameed, Rico Sennrich

Kuvost: A Large-Scale Human-Annotated English to Central Kurdish Speech Translation Dataset Driven from English Common Voice

Mohammad Mohammadamini, Daban Jaff, Sara Jamal, Ibrahim Ahmed, Hawkar Omar

Conversational SimulMT: Efficient Simultaneous Translation with Large Language Models

Minghan Wang, Thuy-Trang Vu, Yuxia Wang, Ehsan Shareghi, Gholamreza Haffari

Effects of automatic alignment on speech translation metrics

Matt Post, Hieu Hoang

SparQLe: Speech Queries to Text Translation Through LLMs

Amirbek Djanibekov, Hanan Aldarmaki

SSR: Alignment-Aware Modality Connector for Speech Language Models

Weiting Tan, Hirofumi Inaguma, Ning Dong, Paden D. Tomasello, Xutai Ma

The Warmup Dilemma: How Learning Rate Strategies Impact Speech-to-Text Model Convergence

Marco Gaido, Sara Papi, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo

Quality-Aware Decoding: Unifying Quality Estimation and Decoding

Sai Koneru, Matthias Huck, Miriam Exel, Jan Niehues

NUTSHELL: A Dataset for Abstract Generation from Scientific Talks

Maike Züfle, Sara Papi, Beatrice Savoldi, Marco Gaido, Luisa Bentivogli

Streaming Sequence Transduction through Dynamic Compression

Weiting Tan, Yunmo Chen, Tongfei Chen, Guanghui Qin, Haoran Xu

The 2025 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results

Anya Belz, Craig Thomson, Javier González Corbelle, Malo Ruelle

U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in Large Language Models

Konstantin Chernyshev, Vitaliy Polshkov, Vlad Stepanov, Alex Myasnikov, Ekaterina Artemova

An Analysis of Datasets, Metrics and Models in Keyphrase Generation

Florian Boudin, Akiko Aizawa

Natural Language Counterfactual Explanations in Financial Text Classification: A Comparison of Generators and Evaluation Metrics

Karol Dobiczek, Patrick Altmeyer, Cynthia C. S. Liem

Single- vs. Dual-Prompt Dialogue Generation with LLMs for Job Interviews in Human Resources

Joachim De Baer, A. Seza Doğruöz, Thomas Demeester, Chris Develder

sPhinX: Sample Efficient Multilingual Instruction Fine-Tuning Through N-shot Guided Prompting

Sanchit Ahuja, Kumar Tanmay, Hardik Hansrajbhai Chauhan, Barun Patra, Kriti Aggarwal

Finance Language Model Evaluation (FLaME)

Glenn Matlin, Mika Okamoto, Huzaifa Pardawala, Yang Yang, Sudheer Chava

Fine-Grained Constraint Generation-Verification for Improved Instruction-Following

Zhixiang Liang, Zhenyu Hou, Xiao Wang

(Dis)improved?! How Simplified Language Affects Large Language Model Performance across Languages

Miriam Anschütz, Anastasiya Damaratskaya, Chaeeun Joy Lee, Arthur Schmalz, Edoardo Mosca

MCQFormatBench: Robustness Tests for Multiple-Choice Questions

Hiroo Takizawa, Saku Sugawara, Akiko Aizawa

PATCH! Psychometrics-AssisTed BenCHmarking of Large Language Models against Human Populations: A Case Study of Proficiency in 8th Grade Mathematics

Qixiang Fang, Daniel Oberski, Dong Nguyen

Coreference as an indicator of context scope in multimodal narrative

Nikolai Ilinykh, Shalom Lappin, Asad B. Sayeed, Sharid Loáiciga

PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins

Sihan Chen, John P. Lalor, Yi Yang, Ahmed Abbasi

From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks

Andreas Stephan, Dawei Zhu, Matthias Aßenmacher, Xiaoyu Shen, Benjamin Roth

Evaluating Intermediate Reasoning of Code-Assisted Large Language Models for Mathematics

Zena Al-Khalili, Nick Howell, Dietrich Klakow

Ad-hoc Concept Forming in the Game Codenames as a Means for Evaluating Large Language Models

Sherzod Hakimov, Lara Pfennigschmidt, David Schlangen

Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents

Ashley Lewis, Michael White, Jing Liu, Toshiaki Koike-Akino, Kieran Parsons

Prompt, Translate, Fine-Tune, Re-Initialize, or Instruction-Tune? Adapting LLMs for In-Context Learning in Low-Resource Languages

Christopher Toukmaji, Jeffrey Flanigan

Bridging the LLM Accessibility Divide? Performance, Fairness, and Cost of Closed versus Open LLMs for Automated Essay Scoring

Kezia Oketch, John P. Lalor, Yi Yang, Ahmed Abbasi

Towards Better Open-Ended Text Generation: A Multicriteria Evaluation Framework

Esteban Garces Arias, Hannah Blocher, Julian Rodemann, Meimingwei Li, Christian Heumann

Curse of bilinguality: Evaluating monolingual and bilingual language models on Chinese linguistic benchmarks

Yuwen Zhou, Yevgen Matusevych

ReproHum #0729-04: Partial reproduction of the human evaluation of the MemSum and NeuSum summarisation systems

Simon Mille, Michela Lorandi

ReproHum #0067-01: A Reproduction of the Evaluation of Cross-Lingual Summarization

Supryadi, Chuang Liu, Deyi Xiong

ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation

Kristýna Onderková, Mateusz Lango, Patricia Schmidtova, Ondřej Dušek

ReproHum: #0744-02: Investigating the Reproducibility of Semantic Preservation Human Evaluations

Mohammad Arvan, Natalie Parde

ReproHum #0033-05: Human Evaluation of Factuality from A Multidisciplinary Perspective

Andra-Maria Florescu, Marius Micluta-Campeanu, Stefana Arina Tabusca, Liviu P Dinu

ReproHum #0031-01: Reproducing the Human Evaluation of Readability from “It is AI’s Turn to Ask Humans a Question”

Daniel Braun

ReproHum #0744-02: A Reproduction of the Human Evaluation of Meaning Preservation in “Factorising Meaning and Form for Intent-Preserving Paraphrasing”

Julius Steen, Katja Markert

ReproHum #0729-04: Human Evaluation Reproduction Report for “MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes”

Simeon Junker

Improving Large Language Model Confidence Estimates using Extractive Rationales for Classification

Jane Arleth dela Cruz, Iris Hendrickx, Martha Larson

Shallow Preference Signals: Large Language Model Aligns Even Better with Truncated Data?

Xuan Qi, Jiahao Qiu, Xinzhe Juan, Yue Wu, Mengdi Wang

PapersPlease: A Benchmark for Evaluating Motivational Values of Large Language Models Based on ERG Theory

Junho Myung, Yeon Su Park, Sunwoo Kim, Shin Yoo, Alice Oh

Fine-Tune on the Format: First Improving Multiple-Choice Evaluation for Intermediate LLM Checkpoints

Alec Bunn, Sarah Wiegreffe, Ben Bogin

Event-based evaluation of abstractive news summarization

Huiling You, Samia Touileb, Lilja Øvrelid, Erik Velldal

Big Escape Benchmark: Evaluating Human-Like Reasoning in Language Models via Real-World Escape Room Challenges

Zinan Tang, QiYao Sun

Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish

Elif Ecem Umutlu, Ayse Aysu Cengiz, Ahmet Kaan Sever, Seyma Erdem, Burak Aytan

ELAB: Extensive LLM Alignment Benchmark in Persian Language

Zahra Pourbahman, Fatemeh Rajabi, Mohammadhossein Sadeghi, Omid Ghahroodi, Somayeh Bakhshaei

Investigating the Robustness of Retrieval-Augmented Generation at the Query Level

Sezen Perçin, Xin Su, Qutub Sha Syed, Phillip Howard, Aleksei Kuvshinov

Analyzing the Sensitivity of Vision Language Models in Visual Question Answering

Monika Shah, Sudarshan Balaji, Somdeb Sarkhel, Sanorita Dey, Deepak Venugopal