COLING 2025

1,226 papers

Why Does ChatGPT “Delve” So Much? Exploring the Sources of Lexical Overrepresentation in Large Language Models

Tom S Juzek, Zina B. Ward

ModaFact: Multi-paradigm Evaluation for Joint Event Modality and Factuality Detection

Marco Rovera, Serena Cristoforetti, Sara Tonelli

Analyzing the Attention Heads for Pronoun Disambiguation in Context-aware Machine Translation Models

Paweł Mąka, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis

NLP for preserving Torlak, a vulnerable low-resource Slavic language

Li Tang, Teodora Vuković

Just Read the Codebook! Make Use of Quality Codebooks in Zero-Shot Classification of Multilabel Frame Datasets

Mattes Ruckdeschel

Towards Human Understanding of Paraphrase Types in Large Language Models

Dominik Meier, Jan Philip Wahle, Terry Ruas, Bela Gipp

HYDEN: Hyperbolic Density Representations for Medical Images and Reports

Zhi Qiao, Linbin Han, Xiantong Zhen, Jiahong Gao, Zhen Qian

Semi-Automated Construction of Sense-Annotated Datasets for Practically Any Language

Jai Riley, Bradley Hauer, Nafisa Sadaf Hriti, Guoqing Luo, Amirreza Mirzaei

Representation Purification for End-to-End Speech Translation

Chengwei Zhang, Yue Zhou, Rui Zhao, Yidong Chen, Xiaodong Shi

Leveraging Taxonomy and LLMs for Improved Multimodal Hierarchical Classification

Shijing Chen, Mohamed Reda Bouadjenek, Usman Naseem, Basem Suleiman, Shoaib Jameel

Large Language Models with Reinforcement Learning from Human Feedback Approach for Enhancing Explainable Sexism Detection

Ali Riahi Samani, Tianhao Wang, Kangshuo Li, Feng Chen

DROWN: Towards Tighter LiRPA-based Robustness Certification

Yunruo Zhang, Tianyu Du, Shouling Ji, Shanqing Guo

Multi-Modal Multi-Granularity Tokenizer for Chu Bamboo Slips

Yingfa Chen, Chenlong Hu, Cong Feng, Chenyang Song, Shi Yu

Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination

Eva Sánchez Salido, Roser Morante, Julio Gonzalo, Guillermo Marco, Jorge Carrillo-de-Albornoz

LASS: A Novel and Economical Data Augmentation Framework Based on Language Models for Debiasing Opinion Summarization

Yanyue Zhang, Pengfei Li, Yilong Lai, Yulan He, Deyu Zhou

VLR-Bench: Multilingual Benchmark Dataset for Vision-Language Retrieval Augmented Generation

HyeonSeok Lim, Dongjae Shin, Seohyun Song, Inho Won, MinJun Kim

It’s What You Say and How You Say It: Investigating the Effect of Linguistic vs. Behavioral Adaptation in Task-Oriented Chatbots

Lindsey Vanderlyn, Ngoc Thang Vu

BERT-based Classical Arabic Poetry Authorship Attribution

Lama Alqurashi, Serge Sharoff, Janet Watson, Jacob Blakesley

Multi-Layered Evaluation Using a Fusion of Metrics and LLMs as Judges in Open-Domain Question Answering

Rashin Rahnamoun, Mehrnoush Shamsfard

MuPe Life Stories Dataset: Spontaneous Speech in Brazilian Portuguese with a Case Study Evaluation on ASR Bias against Speakers Groups and Topic Modeling

Sidney Evaldo Leal, Arnaldo Candido Junior, Ricardo Marcacini, Edresson Casanova, Odilon Gonçalves

Hi-GEC: Hindi Grammar Error Correction in Low Resource Scenario

Ujjwal Sharma, Pushpak Bhattacharyya

Evaluating Readability Metrics for German Medical Text Simplification

Karen Scholz, Markus Wenzel

Small Language Models Also Work With Small Vocabularies: Probing the Linguistic Abilities of Grapheme- and Phoneme-Based Baby Llamas

Bastian Bunzeck, Daniel Duran, Leonie Schade, Sina Zarrieß

Empirical Study on Data Attributes Insufficiency of Evaluation Benchmarks for LLMs

Chuang Liu, Renren Jin, Zheng Yao, Tianyi Li, Liang Cheng

Continual Learning Using Only Large Language Model Prompting

Jiabao Qiu, Zixuan Ke, Bing Liu

PIRsuader: A Persuasive Chatbot for Mitigating Psychological Insulin Resistance in Type-2 Diabetic Patients

Sujatha Das Gollapalli, See-Kiong Ng

Egalitarian Language Representation in Language Models: It All Begins with Tokenizers

Menan Velayuthan, Kengatharaiyer Sarveswaran

CateEA: Enhancing Entity Alignment via Implicit Category Supervision

Guan Dong Feng, Tao Ren, Jun Hu, Dan dan Wang

CHIFRAUD: A Long-term Web Text Dataset for Chinese Fraud Detection

Min Tang, Lixin Zou, ZHE JIN, ShuJie Cui, Shiuan Ni Liang

WER We Stand: Benchmarking Urdu ASR Models

Samee Arif, Aamina Jamal Khan, Mustafa Abbas, Agha Ali Raza, Awais Athar

Automated Detection of Tropes In Short Texts

Alessandra Flaccavento, Youri Peskine, Paolo Papotti, Riccardo Torlone, Raphael Troncy

JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Models

Junfeng Jiang, Jiahao Huang, Akiko Aizawa

CoPrUS: Consistency Preserving Utterance Synthesis towards more realistic benchmark dialogues

Sebastian Steindl, Ulrich Schäfer, Bernd Ludwig

DAEA: Enhancing Entity Alignment in Real-World Knowledge Graphs Through Multi-Source Domain Adaptation

Linyan Yang, Shiqiao Zhou, Jingwei Cheng, Fu Zhang, Jizheng Wan

ADAPTIVE IE: Investigating the Complementarity of Human-AI Collaboration to Adaptively Extract Information on-the-fly

Ishani Mondal, Michelle Yuan, Anandhavelu N, Aparna Garimella, Francis Ferraro

Benchmark Creation for Aspect-Based Sentiment Analysis in Low-Resource Odia Language and Evaluation through Fine-Tuning of Multilingual Models

Lipika Dewangan, Zoyah Afsheen Sayeed, Chandresh Maurya

LLMs May Perform MCQA by Selecting the Least Incorrect Option

Haochun Wang, Sendong Zhao, Zewen Qiang, Nuwa Xi, Bing Qin

Biases in Large Language Model-Elicited Text: A Case Study in Natural Language Inference

Grace Proebsting, Adam Poliak

On Evaluating LLMs’ Capabilities as Functional Approximators: A Bayesian Evaluation Framework

Shoaib Ahmed Siddiqui, Yanzhi Chen, Juyeon Heo, Menglin Xia, Adrian Weller

Uchaguzi-2022: A Dataset of Citizen Reports on the 2022 Kenyan Election

Roberto Mondini, Neema Kotonya, Robert L Logan IV, Elizabeth M. Olson, Angela Oduor Lungati

MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL

Xuanliang Zhang, Dingzirui Wang, Longxu Dou, Qingfu Zhu, Wanxiang Che

Multilingual Knowledge Editing with Language-Agnostic Factual Neurons

Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Yufeng Chen

Mix-of-Granularity: Optimize the Chunking Granularity for Retrieval-Augmented Generation

Zijie Zhong, Hanwen Liu, Xiaoya Cui, Xiaofan Zhang, Zengchang Qin

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models

Taiqiang Wu, Chaofan Tao, Jiahao Wang, Runming Yang, Zhe Zhao

PADO: Personality-induced multi-Agents for Detecting OCEAN in human-generated texts

Haein Yeo, Taehyeong Noh, Seungwan Jin, Kyungsik Han

Using Game Play to Investigate Multimodal and Conversational Grounding in Large Multimodal Models

Sherzod Hakimov, Yerkezhan Abdullayeva, Kushal Koshti, Antonia Schmidt, Yan Weiser

A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Models

Ahatsham Hayat, Mohammad R. Hasan

Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs

Taiqiang Wu, Zhe Zhao, Jiahao Wang, Xingyu Bai, Lei Wang

A Novel Negative Sample Generation Method for Contrastive Learning in Hierarchical Text Classification

Juncheng Zhou, Lijuan Zhang, Yachen He, Rongli Fan, Lei Zhang

MQA-KEAL: Multi-hop Question Answering under Knowledge Editing for Arabic Language

Muhammad Asif Ali, Nawal Daftardar, Mutayyba Waheed, Jianbin Qin, Di Wang

PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent

Jiateng Liu, Lin Ai, Zizhou Liu, Payam Karisani, Zheng Hui

MOPO: Multi-Objective Prompt Optimization for Affective Text Generation

Yarik Menchaca Resendiz, Roman Klinger

MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators

Qingyu Lu, Liang Ding, Kanjian Zhang, Jinxia Zhang, Dacheng Tao

Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learning

Aditya Narayan Sankaran, Reza Farahbakhsh, Noel Crespi

Leveraging Language-based Representations for Better Solving Symbol-related Problems with Large Language Models

Yile Wang, Sijie Cheng, Zixin Sun, Peng Li, Yang Liu

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation

Hongyun Zhou, Xiangyu Lu, Wang Xu, Conghui Zhu, Tiejun Zhao

Montague semantics and modifier consistency measurement in neural language models

Danilo S. Carvalho, Edoardo Manino, Julia Rozanova, Lucas Cordeiro, Andre Freitas

Persona-Consistent Dialogue Generation via Pseudo Preference Tuning

Junya Takayama, Masaya Ohagi, Tomoya Mizumoto, Katsumasa Yoshikawa

GraphOTTER: Evolving LLM-based Graph Reasoning for Complex Table Question Answering

Qianlong Li, Chen Huang, Shuai Li, Yuanxin Xiang, Deng Xiong

ECC: Synergizing Emotion, Cause and Commonsense for Empathetic Dialogue Generation

Xu Wang, Bo Wang, Yihong Tang, Dongming Zhao, Jing Liu

VeritasQA: A Truthfulness Benchmark Aimed at Multilingual Transferability

Javier Aula-Blasco, Júlia Falcão, Susana Sotelo, Silvia Paniagua, Aitor Gonzalez-Agirre

RA-MTR: A Retrieval Augmented Multi-Task Reader based Approach for Inspirational Quote Extraction from Long Documents

Sayantan Adak, Animesh Mukherjee

Post-Hoc Watermarking for Robust Detection in Text Generated by Large Language Models

Jifei Hao, Jipeng Qiang, Yi Zhu, Yun Li, Yunhao Yuan

Multimodal Extraction and Recognition of Arabic Implicit Discourse Relations

Ahmed Ruby, Christian Hardmeier, Sara Stymne

An Active Learning Framework for Inclusive Generation by Large Language Models

Sabit Hassan, Anthony B. Sicilia, Malihe Alikhani

Pseudo-label Data Construction Method and Syntax-enhanced Model for Chinese Semantic Error Recognition

Hongyan Wu, Nankai Lin, Shengyi Jiang, Lianxi Wang, Aimin Yang

Do LLMs Play Dice? Exploring Probability Distribution Sampling in Large Language Models for Behavioral Simulation

Jia Gu, Liang Pang, Huawei Shen, Xueqi Cheng

Knowledge Graph Pooling and Unpooling for Concept Abstraction

Juan Li, Wen Zhang, Zhiqiang Liu, Mingchen Tu, Mingyang Chen

Unveiling Entity-Level Unlearning for Large Language Models: A Comprehensive Analysis

Weitao Ma, Xiaocheng Feng, Weihong Zhong, Lei Huang, Yangfan Ye

When Evolution Strategy Meets Language Models Tuning

Bo Huang, Yuxin Jiang, Mingyang Chen, Yi Wang, Hongyang Chen

Annotating the French Wiktionary with supersenses for large scale lexical analysis: a use case to assess form-meaning relationships within the nominal lexicon

Nicolas Angleraud, Lucie Barque, Marie Candito

TOOL-ED: Enhancing Empathetic Response Generation with the Tool Calling Capability of LLM

Huiying Cao, Yiqun Zhang, Shi Feng, Xiaocui Yang, Daling Wang

A Knowledge Graph Reasoning-Based Model for Computerized Adaptive Testing

Xinyi Qiu, Zhiyun Chen

OpenForecast: A Large-Scale Open-Ended Event Forecasting Dataset

Zhen Wang, Xi Zhou, Yating Yang, Bo Ma, Lei Wang

DiffStyleTTS: Diffusion-based Hierarchical Prosody Modeling for Text-to-Speech with Diverse and Controllable Styles

Jiaxuan Liu, Zhaoci Liu, Yajun Hu, Yingying Gao, Shilei Zhang

Exploring Fine-Grained Human Motion Video Captioning

Bingchan Zhao, Xinyi Liu, Zhuocheng Yu, Tongchen Yang, Yifan Song

LLMs meet Bloom’s Taxonomy: A Cognitive View on Large Language Model Evaluations

Thomas Huber, Christina Niklaus

WIKIGENBENCH:Exploring Full-length Wikipedia Generation under Real-World Scenario

Jiebin Zhang, Eugene J. Yu, Qinyu Chen, Chenhao Xiong, Dawei Zhu

Unlike “Likely”, “Unlike” is Unlikely: BPE-based Segmentation hurts Morphological Derivations in LLMs

Paul Lerner, François Yvon

Synthetic Paths to Integral Truth: Mitigating Hallucinations Caused by Confirmation Bias with Synthetic Data

Changwon Ok, Eunkyeong Lee, Dongsuk Oh

MIT-10M: A Large Scale Parallel Corpus of Multilingual Image Translation

Bo Li, Shaolin Zhu, Lijie Wen

EvoPrompt: Evolving Prompts for Enhanced Zero-Shot Named Entity Recognition with Large Language Models

Zeliang Tong, Zhuojun Ding, Wei Wei

Refer to the Reference: Reference-focused Synthetic Automatic Post-Editing Data Generation

Sourabh Deoghare, Diptesh Kanojia, Pushpak Bhattacharyya

Improving the Efficiency of Visually Augmented Language Models

Paula Ontalvilla, Aitor Ormazabal, Gorka Azkune

What Makes Cryptic Crosswords Challenging for LLMs?

Abdelrahman Sadallah, Daria Kotova, Ekaterina Kochmar

A Benchmark of French ASR Systems Based on Error Severity

Antoine Tholly, Jane Wottawa, Mickael Rouvier, Richard Dufour

TMATH A Dataset for Evaluating Large Language Models in Generating Educational Hints for Math Word Problems

Changyong Qi, Yuang Wei, Haoxin Xu, Longwei Zheng, Peiji Chen

Can Large Language Models Understand You Better? An MBTI Personality Detection Dataset Aligned with Population Traits

Bohan Li, Jiannan Guan, Longxu Dou, Yunlong Feng, Dingzirui Wang

Towards Data Contamination Detection for Modern Large Language Models: Limitations, Inconsistencies, and Oracle Challenges

Vinay Samuel, Yue Zhou, Henry Peng Zou

Large Language Models as an Indirect Reasoner: Contrapositive and Contradiction for Automated Reasoning

Yanfang Zhang, Yiliu Sun, Yibing Zhan, Dapeng Tao, Dacheng Tao

Evaluating Open-Source ASR Systems: Performance Across Diverse Audio Conditions and Error Correction Methods

Saki Imai, Tahiya Chowdhury, Amanda J. Stent

Attention-Seeker: Dynamic Self-Attention Scoring for Unsupervised Keyphrase Extraction

Erwin Daniel Lopez Zapata, Cheng Tang, Atsushi Shimada

Enhancing Criminal Investigation Analysis with Summarization and Memory-based Retrieval-Augmented Generation: A Comprehensive Evaluation of Real Case Data

Mads Skipanes, Tollef Emil Jørgensen, Kyle Porter, Gianluca Demartini, Sule Yildirim Yayilgan

SILC-EFSA: Self-aware In-context Learning Correction for Entity-level Financial Sentiment Analysis

Senbin Zhu, Chenyuan He, Hongde Liu, Pengcheng Dong, Hanjie Zhao

Towards Robust Comparisons of NLP Models: A Case Study

Vicente Ivan Sanchez Carmona, Shanshan Jiang, Bin Dong

Measuring the Robustness of Reference-Free Dialogue Evaluation Systems

Justin Vasselli, Adam Nohejl, Taro Watanabe

Evaluating Generalization Capability of Language Models across Abductive, Deductive and Inductive Logical Reasoning

Yu Sheng, Wanting Wen, Linjing Li, Daniel Zeng

Extracting structure from an LLM - how to improve on surprisal-based models of Human Language Processing

Daphne P. Wang, Mehrnoosh Sadrzadeh, Miloš Stanojević, Wing-Yee Chow, Richard Breheny

SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding

Zhenglin Wang, Jialong Wu, Yilong Lai, Congzhi Zhang, Deyu Zhou

ACL-rlg: A Dataset for Reading List Generation

Julien Aubert-Béduchaud, Florian Boudin, Béatrice Daille, Richard Dufour