ACL 2024

2,718 papers

Improving Vision-Language Cross-Lingual Transfer with Scheduled Unfreezing

Max Reinhardt, Gregor Geigle, Radu Timofte, Goran Glavaš

Causal and Temporal Inference in Visual Question Generation by Utilizing Pre-trained Models

Zhanghao Hu, Frank Keller

SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition

Hao Wang, Shuhei Kurita, Shuichiro Shimizu, Daisuke Kawahara

Vision Language Models for Spreadsheet Understanding: Challenges and Opportunities

Shiyu Xia, Junyu Xiong, Haoyu Dong, Jianbo Zhao, Yuzhang Tian

Enhancing Conceptual Understanding in Multimodal Contrastive Learning through Hard Negative Samples

Philipp J. Rösch, Norbert Oswald, Michaela Geierhos, Jindřich Libovický

VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Tool

Yan Wang, Yawen Zeng, Jingsheng Zheng, Xiaofen Xing, Jin Xu

English-to-Japanese Multimodal Machine Translation Based on Image-Text Matching of Lecture Videos

Ayu Teramen, Takumi Ohtsuka, Risa Kondo, Tomoyuki Kajiwara, Takashi Ninomiya

Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation

Malvina Nikandrou, Georgios Pantazopoulos, Ioannis Konstas, Alessandro Suglia

How and where does CLIP process negation?

Vincent Quantmeyer, Pablo Mosteiro, Albert Gatt

Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models

Holy Lovenia, Wenliang Dai, Samuel Cahyawijaya, Ziwei Ji, Pascale Fung

LMPT: Prompt Tuning with Class-Specific Embedding Loss for Long-Tailed Multi-Label Visual Recognition

Peng Xia, Di Xu, Ming Hu, Lie Ju, Zongyuan Ge

mBLIP: Efficient Bootstrapping of Multilingual Vision-LLMs

Gregor Geigle, Abhay Jain, Radu Timofte, Goran Glavaš

WISMIR3: A Multi-Modal Dataset to Challenge Text-Image Retrieval Approaches

Florian Schneider, Chris Biemann

MedDec: A Dataset for Extracting Medical Decisions from Discharge Summaries

Mohamed Elgaar, Jiali Cheng, Nidhi Vakil, Hadi Amiri, Leo Anthony Celi

Concise and Precise Context Compression for Tool-Using Language Models

Yang Xu, Yunlong Feng, Honglin Mu, Yutai Hou, Yitong Li

RePair: Automated Program Repair with Process-based Feedback

Yuze Zhao, Zhenya Huang, Yixiao Ma, Rui Li, Kai Zhang

KEEP CHATTING! An Attractive Dataset for Continuous Conversation Agents

Yihe Wang, Jin Liu, Yao Wan, Yitong Li, Zifeng Liu

EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Records

Jaehee Ryu, Seonhee Cho, Gyubok Lee, Edward Choi

RESEMO: A Benchmark Chinese Dataset for Studying Responsive Emotion from Social Media Content

Bo Hu, Meng Zhang, Chenfei Xie, Yuanhe Tian, Yan Song

On the Robustness of Document-Level Relation Extraction Models to Entity Name Variations

Shiao Meng, Xuming Hu, Aiwei Liu, Fukun Ma, Yawen Yang

FragRel: Exploiting Fragment-level Relations in the External Memory of Large Language Models

Xihang Yue, Linchao Zhu, Yi Yang

Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning?

Muhammad Reza Qorib, Geonsik Moon, Hwee Tou Ng

DMIN: A Discourse-specific Multi-granularity Integration Network for Conversational Aspect-based Sentiment Quadruple Analysis

Peijie Huang, Xisheng Xiao, Yuhong Xu, Jiawei Chen

CF-TCIR: A Compositor-Free Framework for Hierarchical Text-Conditioned Image Retrieval

Yuchen Yang, Yu Wang, Yanfeng Wang

VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraft

Yubo Dong, Xukun Zhu, Zhengzhe Pan, Linchao Zhu, Yi Yang

How Do Moral Emotions Shape Political Participation? A Cross-Cultural Analysis of Online Petitions Using Language Models

Jaehong Kim, Chaeyoon Jeong, Seongchan Park, Meeyoung Cha, Wonjae Lee

PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns

Yew Ken Chia, Vernon Toh, Deepanway Ghosal, Lidong Bing, Soujanya Poria

ContextBLIP: Doubly Contextual Alignment for Contrastive Image Retrieval from Linguistically Complex Descriptions

Honglin Lin, Siyu Li, Guoshun Nan, Chaoyue Tang, Xueting Wang

Sowing the Wind, Reaping the Whirlwind: The Impact of Editing Language Models

Rima Hazra, Sayan Layek, Somnath Banerjee, Soujanya Poria

Selective Prompting Tuning for Personalized Conversations with LLMs

Qiushi Huang, Xubo Liu, Tom Ko, Bo Wu, Wenwu Wang

Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning

Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu

Label-aware Hard Negative Sampling Strategies with Momentum Contrastive Learning for Implicit Hate Speech Detection

Jaehoon Kim, Seungwan Jin, Sohyun Park, Someen Park, Kyungsik Han

Can LLMs Speak For Diverse People? Tuning LLMs via Debate to Generate Controllable Controversial Statements

Ming Li, Jiuhai Chen, Lichang Chen, Tianyi Zhou

Chain-of-History Reasoning for Temporal Knowledge Graph Forecasting

Yuwei Xia, Ding Wang, Qiang Liu, Liang Wang, Shu Wu

Ask LLMs Directly, “What shapes your bias?”: Measuring Social Bias in Large Language Models

Jisu Shin, Hoyun Song, Huije Lee, Soyeong Jeong, Jong Park

MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources

Dongkyu Lee, Chandana Satya Prakash, Jack Fitzgerald, Jens Lehmann

DIMSIM: Distilled Multilingual Critics for Indic Text Simplification

Sneha Mondal, Ashish Agrawal, Ritika, Preethi Jyothi, Aravindan Raghuveer

Unveiling the Spectrum of Data Contamination in Language Model: A Survey from Detection to Remediation

Chunyuan Deng, Yilun Zhao, Yuzhao Heng, Yitong Li, Jiannan Cao

Exploring Reasoning Biases in Large Language Models Through Syllogism: Insights from the NeuBAROCO Dataset

Kentaro Ozeki, Risako Ando, Takanobu Morishita, Hirohiko Abe, Koji Mineshima

A Large Collection of Model-generated Contradictory Responses for Consistency-aware Dialogue Systems

Shiki Sato, Reina Akama, Jun Suzuki, Kentaro Inui

Defending LLMs against Jailbreaking Attacks via Backtranslation

Yihan Wang, Zhouxing Shi, Andrew Bai, Cho-jui Hsieh

ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models

Yuzhao Heng, Chunyuan Deng, Yitong Li, Yue Yu, Yinghao Li

Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning

Jeonghoon Kim, Heesoo Jung, Hyeju Jang, Hogun Park

Semantic Compression for Word and Sentence Embeddings using Discrete Wavelet Transform

Rana Salama, Abdou Youssef, Mona Diab

A Survey on Predicting the Factuality and the Bias of News Media

Preslav Nakov, Jisun An, Haewoon Kwak, Muhammad Arslan Manzoor, Zain Muhammad Mujahid

Retrieval-Augmented Retrieval: Large Language Models are Strong Zero-Shot Retriever

Tao Shen, Guodong Long, Xiubo Geng, Chongyang Tao, Yibin Lei

No perspective, no perception!! Perspective-aware Healthcare Answer Summarization

Gauri Naik, Sharad Chandakacherla, Shweta Yadav, Md Shad Akhtar

SCALE: Synergized Collaboration of Asymmetric Language Translation Engines

Xin Cheng, Xun Wang, Tao Ge, Si-Qing Chen, Furu Wei

Visual In-Context Learning for Large Vision-Language Models

Yucheng Zhou, Xiang Li, Qianning Wang, Jianbing Shen

A Critical Study of What Code-LLMs (Do Not) Learn

Abhinav Anand, Shweta Verma, Krishna Narasimhan, Mira Mezini

Fine-tuning Language Models for Joint Rewriting and Completion of Code with Potential Bugs

Dingmin Wang, Jinman Zhao, Hengzhi Pei, Samson Tan, Sheng Zha

Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding

Xintong Wang, Jingheng Pan, Liang Ding, Chris Biemann

Protecting Privacy Through Approximating Optimal Parameters for Sequence Unlearning in Language Models

Dohyun Lee, Daniel Rim, Minseok Choi, Jaegul Choo

STARLING: Self-supervised Training of Text-based Reinforcement Learning Agent with Large Language Models

Shreyas Basavatia, Keerthiram Murugesan, Shivam Ratnakar

The PGNSC Benchmark: How Do We Predict Where Information Spreads?

Alexander Taylor, Wei Wang

RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models

Minsoo Kim, Sihwa Lee, Wonyong Sung, Jungwook Choi

Language-Informed Beam Search Decoding for Multilingual Machine Translation

Yilin Yang, Stefan Lee, Prasad Tadepalli

emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li, Zhifu Gao

Rethinking Efficient Multilingual Text Summarization Meta-Evaluation

Rilyn Han, Jiawen Chen, Yixin Liu, Arman Cohan

Token Alignment via Character Matching for Subword Completion

Ben Athiwaratkun, Shiqi Wang, Mingyue Shang, Yuchen Tian, Zijian Wang

CToolEval: A Chinese Benchmark for LLM-Powered Agent Evaluation in Real-World API Interactions

Zishan Guo, Yufei Huang, Deyi Xiong

From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguards

Khaoula Chehbouni, Megha Roshan, Emmanuel Ma, Futian Wei, Afaf Taik

From Tarzan to Tolkien: Controlling the Language Proficiency Level of LLMs for Content Generation

Ali Malik, Stephen Mayhew, Christopher Piech, Klinton Bicknell

Hire a Linguist!: Learning Endangered Languages in LLMs with In-Context Linguistic Descriptions

Kexun Zhang, Yee Choi, Zhenqiao Song, Taiqi He, William Yang Wang

Small Language Models Need Strong Verifiers to Self-Correct Reasoning

Yunxiang Zhang, Muhammad Khalifa, Lajanugen Logeswaran, Jaekyeom Kim, Moontae Lee

PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs

Rongzhi Zhang, Jiaming Shen, Tianqi Liu, Haorui Wang, Zhen Qin

A Meta-Learning Perspective on Transformers for Causal Language Modeling

Xinbo Wu, Lav Varshney

Tailoring with Targeted Precision: Edit-Based Agents for Open-Domain Procedure Customization

Yash Kumar Lal, Li Zhang, Faeze Brahman, Bodhisattwa Prasad Majumder, Peter Clark

Verifiable Generation with Subsentence-Level Fine-Grained Citations

Shuyang Cao, Lu Wang

TELLER: A Trustworthy Framework for Explainable, Generalizable and Controllable Fake News Detection

Hui LIU, Wenya Wang, Haoru Li, Haoliang Li

Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learning

Yang Wu, Chenghao Wang, Ece Gumusel, Xiaozhong Liu

Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation

Min-Jae Hwang, Ilia Kulikov, Benjamin Peloquin, Hongyu Gong, Peng-Jen Chen

Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models

Ran Xu, Hejie Cui, Yue Yu, Xuan Kan, Wenqi Shi

CounterCurate: Enhancing Physical and Semantic Visio-Linguistic Compositional Reasoning via Counterfactual Examples

Jianrui Zhang, Mu Cai, Tengyang Xie, Yong Jae Lee

Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction

Dingyao Yu, Yang An, Wei Ye, Xiongfeng Xiao, Shaoguang Mao

What Makes Language Models Good-enough?

Daiki Asami, Saku Sugawara

Deep Exploration of Cross-Lingual Zero-Shot Generalization in Instruction Tuning

Janghoon Han, Changho Lee, Joongbo Shin, Stanley Jungkyu Choi, Honglak Lee

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation

Kun Zhao, Bohao Yang, Chen Tang, Chenghua Lin, Liang Zhan

SAGA: A Participant-specific Examination of Story Alternatives and Goal Applicability for a Deeper Understanding of Complex Events

Sai Vallurupalli, Katrin Erk, Francis Ferraro

Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling Perspective

Ian Porada, Alexandra Olteanu, Kaheer Suleman, Adam Trischler, Jackie Cheung

Embodied Language Learning: Opportunities, Challenges, and Future Directions

Nadine Amin, Julia Rayz

Automatic Bug Detection in LLM-Powered Text-Based Games Using LLMs

Claire Jin, Sudha Rao, Xiangyu Peng, Portia Botchway, Jessica Quaye

TAXI: Evaluating Categorical Knowledge Editing for Language Models

Derek Powell, Walter Gerych, Thomas Hartvigsen

Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning

Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen

Faithful Persona-based Conversational Dataset Generation with Large Language Models

Pegah Jandaghi, Xianghai Sheng, Xinyi Bai, Jay Pujara, Hakim Sidahmed

3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding

Yihao Ding, Lorenzo Vaiani, Caren Han, Jean Lee, Paolo Garza

Model Editing at Scale leads to Gradual and Catastrophic Forgetting

Akshat Gupta, Anurag Rao, Gopala Anumanchipalli

NoteChat: A Dataset of Synthetic Patient-Physician Conversations Conditioned on Clinical Notes

Junda Wang, Zonghai Yao, Zhichao Yang, Huixue Zhou, Rumeng Li

DBQR-QA: A Question Answering Dataset on a Hybrid of Database Querying and Reasoning

Rungsiman Nararatwong, Chung-Chi Chen, Natthawut Kertkeidkachorn, Hiroya Takamura, Ryutaro Ichise

LMDX: Language Model-based Document Information Extraction and Localization

Vincent Perot, Kai Kang, Florian Luisier, Guolong Su, Xiaoyu Sun

Structural Optimization Ambiguity and Simplicity Bias in Unsupervised Neural Grammar Induction

Jinwook Park, kangil kim

Toward Reliable Ad-hoc Scientific Information Extraction: A Case Study on Two Materials Dataset

Satanu Ghosh, Neal Brodnik, Carolina Frey, Collin Holgate, Tresa Pollock

How Far can 100 Samples Go? Unlocking Zero-Shot Translation with Tiny Multi-Parallel Data

Di Wu, Shaomu Tan, Yan Meng, David Stap, Christof Monz

Enhancing Sentence Simplification in Portuguese: Leveraging Paraphrases, Context, and Linguistic Features

Arthur Scalercio, Maria Finatto, Aline Paes

Here’s a Free Lunch: Sanitizing Backdoored Models with Model Merge

Ansh Arora, Xuanli He, Maximilian Mozes, Srinibas Swain, Mark Dras

From One to Many: Expanding the Scope of Toxicity Mitigation in Language Models

Beyza Ermis, Luiza Pozzobon, Sara Hooker, Patrick Lewis

Set the Clock: Temporal Alignment of Pretrained Language Models

Bowen Zhao, Zander Brumbaugh, Yizhong Wang, Hannaneh Hajishirzi, Noah Smith

S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs

Sarkar Snigdha Sarathi Das, Chirag Shah, Mengting Wan, Jennifer Neville, Longqi Yang

Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization

Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long Le

TLCR: Token-Level Continuous Reward for Fine-grained Reinforcement Learning from Human Feedback

Eunseop Yoon, Hee Suk Yoon, SooHwan Eom, Gunsoo Han, Daniel Nam