ACL 2024

2,718 papers

Proving membership in LLM pretraining data via data watermarks

Johnny Wei, Ryan Wang, Robin Jia

Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognition

Yukiya Hono, Koh Mitsuda, Tianyu Zhao, Kentaro Mitsui, Toshiaki Wakatsuki

Improving Machine Translation with Large Language Models: A Preliminary Study with Cooperative Decoding

Jiali Zeng, Fandong Meng, Yongjing Yin, Jie Zhou

CHAMP: A Competition-level Dataset for Fine-Grained Analyses of LLMs’ Mathematical Reasoning Capabilities

Yujun Mao, Yoon Kim, Yilun Zhou

Figuratively Speaking: Authorship Attribution via Multi-Task Figurative Language Modeling

Gregorios Katsios, Ning Sa, Tomek Strzalkowski

Evaluating Structural Generalization in Neural Machine Translation

Ryoma Kumon, Daiki Matsuoka, Hitomi Yanaka

Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning

Zhouhang Xie, Bodhisattwa Prasad Majumder, Mengjie Zhao, Yoshinori Maeda, Keiichi Yamada

Toucan: Many-to-Many Translation for 150 African Language Pairs

AbdelRahim Elmadany, Ife Adebara, Muhammad Abdul-Mageed

Leveraging LLM Reasoning Enhances Personalized Recommender Systems

Alicia Tsai, Adam Kraft, Long Jin, Chenwei Cai, Anahita Hosseini

Extracting Polymer Nanocomposite Samples from Full-Length Documents

Ghazal Khalighinejad, Defne Circi, L. Brinson, Bhuwan Dhingra

360∘REA: Towards A Reusable Experience Accumulation with 360∘ Assessment for Multi-Agent System

Shen Gao, Hao Li, Zhengliang Shi, Chengrui Huang, Quan Tu

PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answering

Jannat Meem, Muhammad Rashid, Yue Dong, Vagelis Hristidis

The Art of Defending: A Systematic Evaluation and Analysis of LLM Defense Strategies on Safety and Over-Defensiveness

Neeraj Varshney, Pavel Dolin, Agastya Seth, Chitta Baral

Aligning Large Multimodal Models with Factually Augmented RLHF

Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li

FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models

Gagan Bhatia, El Moatez Billah Nagoudi, Hasan Cavusoglu, Muhammad Abdul-Mageed

EcoRank: Budget-Constrained Text Re-ranking Using Large Language Models

Muhammad Rashid, Jannat Meem, Yue Dong, Vagelis Hristidis

InFoBench: Evaluating Instruction Following Ability in Large Language Models

Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, SangWoo Cho

XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags

Faisal Tareque Shohan, Mir Tafseer Nayeem, Samsul Islam, Abu Ubaida Akash, Shafiq Joty

KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions

Fangyuan Xu, Kyle Lo, Luca Soldaini, Bailey Kuehl, Eunsol Choi

Differentially Private Knowledge Distillation via Synthetic Text Generation

James Flemings, Murali Annavaram

Language Model Priors and Data Augmentation Strategies for Low-resource Machine Translation: A Case Study Using Finnish to Northern Sámi

Jonne Sälevä, Constantine Lignos

Selective “Selective Prediction”: Reducing Unnecessary Abstention in Vision-Language Reasoning

Tejas Srinivasan, Jack Hessel, Tanmay Gupta, Bill Yuchen Lin, Yejin Choi

SMART: Submodular Data Mixture Strategy for Instruction Tuning

H S V N S Kowndinya Renduchintala, Sumit Bhatia, Ganesh Ramakrishnan

RadGraph-XL: A Large-Scale Expert-Annotated Dataset for Entity and Relation Extraction from Radiology Reports

Jean-Benoit Delbrouck, Pierre Chambon, Zhihong Chen, Maya Varma, Andrew Johnston

CIDAR: Culturally Relevant Instruction Dataset For Arabic

Zaid Alyafeai, Khalid Almubarak, Ahmed Ashraf, Deema Alnuhait, Saied Alshahrani

Measuring and Addressing Indexical Bias in Information Retrieval

Caleb Ziems, William Held, Jane Dwivedi-Yu, Diyi Yang

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

Tianyu Zheng, Ge Zhang, Tianhao Shen, Xueling Liu, Bill Yuchen Lin

Understanding the Impacts of Language Technologies’ Performance Disparities on African American Language Speakers

Jay Cunningham, Su Lin Blodgett, Michael Madaio, Hal Daume III, Christina Harrington

TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extraction

Kuan-Hao Huang, I-Hung Hsu, Tanmay Parekh, Zhiyu Xie, Zixuan Zhang

CaLM: Contrasting Large and Small Language Models to Verify Grounded Generation

I-Hung Hsu, Zifeng Wang, Long Le, Lesly Miculicich, Nanyun Peng

Argument-Aware Approach To Event Linking

I-Hung Hsu, Zihan Xue, Nilay Pochhi, Sahil Bansal, Prem Natarajan

Choose Your Transformer: Improved Transferability Estimation of Transformer Models on Classification Tasks

Lukas Garbaciauskas, Max Ploner, Alan Akbik

Empowering Large Language Models for Textual Data Augmentation

Yichuan Li, Kaize Ding, Jianling Wang, Kyumin Lee

Chaos with Keywords: Exposing Large Language Models Sycophancy to Misleading Keywords and Evaluating Defense Strategies

Aswin Rrv, Nemika Tyagi, Md Nayem Uddin, Neeraj Varshney, Chitta Baral

HelloFresh: LLM Evalutions on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits

Tim Franzmeyer, Aleksandar Shtedritski, Samuel Albanie, Philip Torr, João F. Henriques

LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores

Yiqi Liu, Nafise Moosavi, Chenghua Lin

Strong hallucinations from negation and how to fix them

Nicholas Asher, Swarnadeep Bhar

Epistemology of Language Models: Do Language Models Have Holistic Knowledge?

Minsu Kim, James Thorne

Paying Attention to Deflections: Mining Pragmatic Nuances for Whataboutism Detection in Online Discourse

Khiem Phi, Noushin Salek Faramarzi, Chenlu Wang, Ritwik Banerjee

Demonstrations Are All You Need: Advancing Offensive Content Paraphrasing using In-Context Learning

Anirudh Som, Karan Sikka, Helen Gent, Ajay Divakaran, Andreas Kathol

Learning to Generate Instruction Tuning Datasets for Zero-Shot Task Adaptation

Nihal Nayak, Yiyang Nan, Avi Trost, Stephen Bach

Diving Deep into the Motion Representation of Video-Text Models

Chinmaya Devaraj, Cornelia Fermuller, Yiannis Aloimonos

SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval

Siwei Wu, Yizhi Li, Kang Zhu, Ge Zhang, Yiming Liang

CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation

Xiwen Liang, Liang Ma, Shanshan Guo, Jianhua Han, Hang Xu

Exciting Mood Changes: A Time-aware Hierarchical Transformer for Change Detection Modelling

Anthony Hills, Talia Tseriotou, Xenia Miscouridou, Adam Tsakalidis, Maria Liakata

Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Tasks

Wenyue Hua, Jiang Guo, Mingwen Dong, Henghui Zhu, Patrick Ng

AdaLomo: Low-memory Optimization with Adaptive Learning Rate

Kai Lv, Hang Yan, Qipeng Guo, Haijun Lv, Xipeng Qiu

Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Loss

Wei He, Marco Idiart, Carolina Scarton, Aline Villavicencio

Countering Reward Over-Optimization in LLM with Demonstration-Guided Reinforcement Learning

Mathieu Rita, Florian Strub, Rahma Chaabouni, Paul Michel, Emmanuel Dupoux

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models

Yizhi Li, Ge Zhang, Xingwei Qu, Jiali Li, Zhaoqun Li

MM-LLMs: Recent Advances in MultiModal Large Language Models

Duzhen Zhang, Yahan Yu, Jiahua Dong, Chenxing Li, Dan Su

Enhanced Language Model Truthfulness with Learnable Intervention and Uncertainty Expression

Farima Fatahi Bayat, Xin Liu, H. Jagadish, Lu Wang

Multi-modal Stance Detection: New Datasets and Model

Bin Liang, Ang Li, Jingqian Zhao, Lin Gui, Min Yang

Non-Autoregressive Machine Translation as Constrained HMM

Haoran Li, Zhanming Jie, Wei Lu

Beyond Text: Leveraging Multi-Task Learning and Cognitive Appraisal Theory for Post-Purchase Intention Analysis

Gerard Yeo, Shaz Furniturewala, Kokil Jaidka

Concept-aware Data Construction Improves In-context Learning of Language Models

Michal Štefánik, Marek Kadlcik, Petr Sojka

Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition

Tariq Alhindi, Smaranda Muresan, Preslav Nakov

Decomposing Argumentative Essay Generation via Dialectical Planning of Complex Reasoning

Yuhang He, Jianzhu Bao, Yang Sun, Bin Liang, Min Yang

Reasons to Reject? Aligning Language Models with Judgments

Weiwen Xu, Deng Cai, Zhisong Zhang, Wai Lam, Shuming Shi

X-ACE: Explainable and Multi-factor Audio Captioning Evaluation

Qian Wang, Jia-Chen Gu, Zhen-Hua Ling

Bayesian Prompt Ensembles: Model Uncertainty Estimation for Black-Box Large Language Models

Francesco Tonolini, Nikolaos Aletras, Jordan Massiah, Gabriella Kazai

Exploiting Target Language Data for Neural Machine Translation Beyond Back Translation

Abudurexiti Reheman, Yingfeng Luo, Junhao Ruan, Chunliang Zhang, Anxiang Ma

A Comprehensive Evaluation of Quantization Strategies for Large Language Models

Renren Jin, Jiangcun Du, Wuwei Huang, Wei Liu, Jian Luan

STSPL-SSC: Semi-Supervised Few-Shot Short Text Clustering with Semantic text similarity Optimized Pseudo-Labels

Wenhua Nie, Lin Deng, Chang-Bo Liu, Jialing Wei, Ruitong Han

Probing the Emergence of Cross-lingual Alignment during LLM Training

Hetong Wang, Pasquale Minervini, Edoardo Ponti

Dual Prompt Tuning based Contrastive Learning for Hierarchical Text Classification

Sishi Xiong, Yu Zhao, Jie Zhang, Li Mengxiang, Zhongjiang He

Prefix Text as a Yarn: Eliciting Non-English Alignment in Foundation Language Model

Runzhe Zhan, Xinyi Yang, Derek Wong, Lidia Chao, Yue Zhang

How Vocabulary Sharing Facilitates Multilingualism in LLaMA?

Fei Yuan, Shuai Yuan, Zhiyong Wu, Lei Li

EmoTransKG: An Innovative Emotion Knowledge Graph to Reveal Emotion Transformation

Huan Zhao, Xupeng Zha, Zixing Zhang

PUB: A Pragmatics Understanding Benchmark for Assessing LLMs’ Pragmatics Capabilities

Settaluri Sravanthi, Meet Doshi, Pavan Tankala, Rudra Murthy, Raj Dabre

Ancient Chinese Glyph Identification Powered by Radical Semantics

Yang Chi, Fausto Giunchiglia, Chuntao Li, Hao Xu

Efficient Training of Language Models with Compact and Consistent Next Token Distributions

Ashutosh Sathe, Sunita Sarawagi

Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

Yihong Dong, Xue Jiang, Huanyu Liu, Zhi Jin, Bin Gu

LC4EE: LLMs as Good Corrector for Event Extraction

Mengna Zhu, Kaisheng Zeng, JibingWu JibingWu, Lihua Liu, Hongbin Huang

Discovering influential text using convolutional neural networks

Megan Ayers, Luke Sanford, Margaret Roberts, Eddie Yang

AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detection

Pia Pachinger, Janis Goldzycher, Anna Planitzer, Wojciech Kusa, Allan Hanbury

BATS: BenchmArking Text Simplicity 🦇

Christin Kreutz, Fabian Haak, Björn Engelmann, Philipp Schaer

Prompting open-source and commercial language models for grammatical error correction of English learner text

Christopher Davis, Andrew Caines, Øistein E. Andersen, Shiva Taslimipoor, Helen Yannakoudakis

Towards Multiple References Era – Addressing Data Leakage and Limited Reference Diversity in Machine Translation Evaluation

Xianfeng Zeng, Yijin Liu, Fandong Meng, Jie Zhou

On the Evaluation of Speech Foundation Models for Spoken Language Understanding

Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan Sharma

Analyze, Generate and Refine: Query Expansion with LLMs for Zero-Shot Open-Domain QA

Xinran Chen, Xuanang Chen, Ben He, Tengfei Wen, Le Sun

Fine-tuning with HED-IT: The impact of human post-editing for dialogical language models

Daniela Occhipinti, Michele Marchi, Irene Mondella, Huiyuan Lai, Felice Dell’Orletta

A Two-Stage Adaptation of Large Language Models for Text Ranking

Longhui Zhang, Yanzhao Zhang, Dingkun Long, Pengjun Xie, Meishan Zhang

Investigating the Impact of Model Instability on Explanations and Uncertainty

Sara Vera Marjanović, Isabelle Augenstein, Christina Lioma

Cache & Distil: Optimising API Calls to Large Language Models

Guillem Ramírez, Matthias Lindemann, Alexandra Birch, Ivan Titov

CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Models

Linhao Yu, Yongqi Leng, Yufei Huang, Shang Wu, Haixin Liu

Continual Few-shot Relation Extraction via Adaptive Gradient Correction and Knowledge Decomposition

Jianpeng Hu, Chengxiang Tan, Jiacheng Xu, XiangyunKong XiangyunKong

MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization

Zhiyu Yang, Zihan Zhou, Shuo Wang, Xin Cong, Xu Han

Visualizing Dialogues: Enhancing Image Selection through Dialogue Understanding with Large Language Models

Chang-Sheng Kao, Yun-Nung Chen

ScaLearn: Simple and Highly Parameter-Efficient Task Transfer by Learning to Scale

Markus Frohmann, Carolin Holtermann, Shahed Masoudian, Anne Lauscher, Navid Rekabsaz

Knowledge Fusion By Evolving Weights of Language Models

Guodong Du, Jing Li, Hanting Liu, Runhua Jiang, Shuyang Yu

Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models

Anthony Sicilia, Hyunwoo Kim, Khyathi Chandu, Malihe Alikhani, Jack Hessel

MusTQ: A Temporal Knowledge Graph Question Answering Dataset for Multi-Step Temporal Reasoning

Tingyi Zhang, Jiaan Wang, Zhixu Li, Jianfeng Qu, An Liu

BranchNorm: Robustly Scaling Extremely Deep Transformers

Yijin Liu, Xianfeng Zeng, Fandong Meng, Jie Zhou

XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection

Yuanhang Yang, Shiyi Qi, Wenchao Gu, Chaozheng Wang, Cuiyun Gao

Instruction Position Matters in Sequence Generation with Large Language Models

Yijin Liu, Xianfeng Zeng, Chenze Shao, Fandong Meng, Jie Zhou

ADAM: Dense Retrieval Distillation with Adaptive Dark Examples

Chongyang Tao, Chang Liu, Tao Shen, Can Xu, Xiubo Geng

Addressing Entity Translation Problem via Translation Difficulty and Context Diversity

Tian Liang, Xing Wang, Mingming Yang, Yujiu Yang, Shuming Shi

Poor-Supervised Evaluation for SuperLLM via Mutual Consistency

Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Boyuan Pan

Discourse Structure-Aware Prefix for Generation-Based End-to-End Argumentation Mining

Yang Sun, Guanrong Chen, Caihua Yang, Jianzhu Bao, Bin Liang