EMNLP 2024

2,910 papers

Interpretable Composition Attribution Enhancement for Visio-linguistic Compositional Understanding

Wei Li, Zhen Huang, Xinmei Tian, Le Lu, Houqiang Li

Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detector

Xiaoxue Cheng, Junyi Li, Wayne Xin Zhao, Hongzhi Zhang, Fuzheng Zhang

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui

Nash CoT: Multi-Path Inference with Preference Equilibrium

Ziqi Zhang, Cunxiang Wang, Xiao Xiong, Yue Zhang, Donglin Wang

SecCoder: Towards Generalizable and Robust Secure Code Generation

Boyu Zhang, Tianyu Du, Junkai Tong, Xuhong Zhang, Kingsum Chow

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models

Yougang Lyu, Lingyong Yan, Shuaiqiang Wang, Haibo Shi, Dawei Yin

DC-Instruct: An Effective Framework for Generative Multi-intent Spoken Language Understanding

Bowen Xing, Lizi Liao, Minlie Huang, Ivor Tsang

Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation

Sweta Agrawal, José G. C. de Souza, Ricardo Rei, António Farinhas, Gonçalo Faria

Can Automatic Metrics Assess High-Quality Translations?

Sweta Agrawal, António Farinhas, Ricardo Rei, Andre Martins

ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM Articles

Kayo Yin, Chinmay Singh, Fyodor O Minakov, Vanessa Milan, Hal Daume III

Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG

William Merrill, Noah A. Smith, Yanai Elazar

Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation

Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, Munazza Zaib, Ahoud Alhazmi

ECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videos

Arpan Phukan, Manish Gupta, Asif Ekbal

Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification

Ming Li, Jike Zhong, Chenxin Li, Liuzhuozheng Li, Nie Lin

More DWUGs: Extending and Evaluating Word Usage Graph Datasets in Multiple Languages

Dominik Schlechtweg, Pierluigi Cassotti, Bill Noble, David Alfter, Sabine Schulte im Walde

The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and Analysis

Yuxiang Zhou, Jiazheng Li, Yanzheng Xiang, Hanqi Yan, Lin Gui

Are LLMs Good Zero-Shot Fallacy Classifiers?

Fengjun Pan, Xiaobao Wu, Zongrui Li, Anh Tuan Luu

Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling

Georgios Pantazopoulos, Malvina Nikandrou, Alessandro Suglia, Oliver Lemon, Arash Eshghi

Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsing

Deokhyung Kang, Seonjeong Hwang, Yunsu Kim, Gary Lee

Pcc-tuning: Breaking the Contrastive Learning Ceiling in Semantic Textual Similarity

Bowen Zhang, Chunping Li

Tools Fail: Detecting Silent Errors in Faulty Tools

Jimin Sun, So Yeon Min, Yingshan Chang, Yonatan Bisk

First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning

Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Shusaku Sone, Masaya Taniguchi

MolTRES: Improving Chemical Language Representation Learning for Molecular Property Prediction

Jun-Hyung Park, Yeachan Kim, Mingyu Lee, Hyuntae Park, SangKeun Lee

Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models

Minghao Wu, Thuy-Trang Vu, Lizhen Qu, Reza Haf

A SMART Mnemonic Sounds like “Glue Tonic”: Mixing LLMs with Student Feedback to Make Mnemonic Learning Stick

Nishant Balepur, Matthew Shu, Alexander Hoyle, Alison Robey, Shi Feng

Large Language Models Can Be Contextual Privacy Protection Learners

Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang

KARL: Knowledge-Aware Retrieval and Representations aid Retention and Learning in Students

Matthew Shu, Nishant Balepur, Shi Feng, Jordan Lee Boyd-Graber

Where am I? Large Language Models Wandering between Semantics and Structures in Long Contexts

Seonmin Koo, JINSUNG KIM, Youngjoon Jang, Chanjun Park, Heuiseok Lim

Enhancing Training Data Attribution for Large Language Models with Fitting Error Consideration

Kangxi Wu, Liang Pang, Huawei Shen, Xueqi Cheng

Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries

Eden Biran, Daniela Gottesman, Sohee Yang, Mor Geva, Amir Globerson

Cluster-Norm for Unsupervised Probing of Knowledge

Walter Laurito, Sharan Maiya, Grégoire Dhimoïla, Owen Ho Wan Yeung, Kaarel Hänni

Rethinking the Evaluation of In-Context Learning for LLMs

Guoxin Yu, Lemao Liu, Mo Yu, Yue Yu, Xiang Ao

MAIR: A Massive Benchmark for Evaluating Instructed Retrieval

Weiwei Sun, Zhengliang Shi, Wu Jiu Long, Lingyong Yan, Xinyu Ma

How Do Your Code LLMs perform? Empowering Code Instruction Tuning with Really Good Data

Yejie Wang, Keqing He, Dayuan Fu, Zhuoma GongQue, Heyang Xu

Automatically Generated Definitions and their utility for Modeling Word Meaning

Francesco Periti, David Alfter, Nina Tahmasebi

Structured Optimal Brain Pruning for Large Language Models

Jiateng Wei, Quan Lu, Ning Jiang, Siqi Li, JINGYANG XIANG

TRoTR: A Framework for Evaluating the Re-contextualization of Text Reuse

Francesco Periti, Pierluigi Cassotti, Stefano Montanelli, Nina Tahmasebi, Dominik Schlechtweg

Contribution of Linguistic Typology to Universal Dependency Parsing: An Empirical Investigation

Ali Basirat, Navid Baradaran Hemmati

Improving Knowledge Graph Completion with Structure-Aware Supervised Contrastive Learning

Jiashi Lin, Lifang Wang, Xinyu Lu, Zhongtian Hu, Wei Zhang

MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languages

Marco Gaido, Sara Papi, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo

Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision

Fan Jiang, Tom Drummond, Trevor Cohn

A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences

Leonardo Bertolazzi, Albert Gatt, Raffaella Bernardi

Curriculum Consistency Learning for Conditional Sentence Generation

Liangxin Liu, Xuebo Liu, Lian Lian, Shengjun Cheng, Jun Rao

Xiangci Li, Jessica Ouyang

Topic-Oriented Open Relation Extraction with A Priori Seed Generation

Linyi Ding, Jinfeng Xiao, Sizhe Zhou, Chaoqi Yang, Jiawei Han

Consecutive Batch Model Editing with HooK Layers

Shuaiyi Li, Yang Deng, Deng Cai, Hongyuan Lu, Liang Chen

A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations

Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, Mizanur Rahman, Mohammad Abdullah Matin Khan

Preserving Generalization of Language models in Few-shot Continual Relation Extraction

Quyen Tran, Nguyen Xuan Thanh, Nguyen Hoang Anh, Nam Le Hai, Trung Le

DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG

JinYoung Kim, Dayoon Ko, Gunhee Kim

Householder Pseudo-Rotation: A Novel Approach to Activation Editing in LLMs with Direction-Magnitude Perspective

Van-Cuong Pham, Thien Huu Nguyen

Holistic Automated Red Teaming for Large Language Models through Top-Down Test Case Generation and Multi-turn Interaction

Jinchuan Zhang, Yan Zhou, Yaxin Liu, Ziming Li, Songlin Hu

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark

Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang

Fewer is More: Boosting Math Reasoning with Reinforced Context Pruning

Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang

Don’t Just Say “I don’t know”! Self-aligning Large Language Models for Responding to Unknown Questions with Explanations

Yang Deng, Yong Zhao, Moxin Li, See-Kiong Ng, Tat-Seng Chua

OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model Prompting

Xukai Liu, Ye Liu, Kai Zhang, Kehang Wang, Qi Liu

Exploring the Practicality of Generative Retrieval on Dynamic Corpora

Chaeeun Kim, Soyoung Yoon, Hyunji Lee, Joel Jang, Sohee Yang

An Analysis and Mitigation of the Reversal Curse

Ang Lv, Kaiyi Zhang, Shufang Xie, Quan Tu, Yuhan Chen

Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages

Jimin Sohn, Haeji Jung, Alex Cheng, Jooeon Kang, Yilin Du

A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models

Zhihao Wang, SHIYU LIU, Jianheng Huang, Wang Zheng, YiXuan Liao

Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning

Qizhou Chen, Taolin Zhang, Xiaofeng He, Dongyang Li, Chengyu Wang

Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination

Eve Fleisig, Genevieve Smith, Madeline Bossi, Ishita Rustagi, Xavier Yin

Leveraging Context-Aware Prompting for Commit Message Generation

Zhihua Jiang, Jianwei Chen, Dongning Rao, Guanghui Ye

DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models

Yiming Huang, Jianwen Luo, Yan Yu, Yitong Zhang, Fangyu Lei

Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction

Sizhe Zhou, Yu Meng, Bowen Jin, Jiawei Han

Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers

Tianhua Zhang, Kun Li, Hongyin Luo, Xixin Wu, James R. Glass

Style-Specific Neurons for Steering LLMs in Text Style Transfer

Wen Lai, Viktor Hangya, Alexander Fraser

How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning Perspective

Teng Xiao, Mingxiao Li, Yige Yuan, Huaisheng Zhu, Chao Cui

1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators?

Yue Huang, Chenrui Fan, Yuan Li, Siyuan Wu, Tianyi Zhou

Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding

Weilin Zhao, Yuxiang Huang, Xu Han, Wang Xu, Chaojun Xiao

CommVQA: Situating Visual Question Answering in Communicative Contexts

Nandita Shankar Naik, Christopher Potts, Elisa Kreiss

Null-Shot Prompting: Rethinking Prompting Large Language Models With Hallucination

Pittawat Taveekitworachai, Febri Abdullah, Ruck Thawonmas

Turn Waste into Worth: Rectifying Top-k Router of MoE

Zhiyuan Zeng, Qipeng Guo, Zhaoye Fei, Zhangyue Yin, Yunhua Zhou

Large Language Models Are Involuntary Truth-Tellers: Exploiting Fallacy Failure for Jailbreak Attacks

Yue Zhou, Henry Peng Zou, Barbara Di Eugenio, Yang Zhang

Learning Personalized Alignment for Evaluating Open-ended Text Generation

Danqing Wang, Kevin Yang, Hanlin Zhu, Xiaomeng Yang, Andrew Cohen

Language Concept Erasure for Language-invariant Dense Retrieval

Zhiqi Huang, Puxuan Yu, Shauli Ravfogel, James Allan

OpenSep: Leveraging Large Language Models with Textual Inversion for Open World Audio Separation

Tanvir Mahmud, Diana Marculescu

FAC2E: Better Understanding Large Language Model Capabilities by Dissociating Language and Cognition

Xiaoqiang Wang, Lingfei Wu, Tengfei Ma, Bang Liu

A Bayesian Approach to Harnessing the Power of LLMs in Authorship Attribution

Zhengmian Hu, Tong Zheng, Heng Huang

BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models

Yi Zeng, Weiyu Sun, Tran Huynh, Dawn Song, Bo Li

Chain and Causal Attention for Efficient Entity Tracking

Erwan Fagnou, Paul Caillon, Blaise Delattre, Alexandre Allauzen

Boosting Logical Fallacy Reasoning in LLMs via Logical Structure Tree

Yuanyuan Lei, Ruihong Huang

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs

John Dang, Arash Ahmadian, Kelly Marchisio, Julia Kreutzer, Ahmet Üstün

Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual Errors

Alex Chandler, Devesh Surve, Hui Su

Analysis of Plan-based Retrieval for Grounded Text Generation

Ameya Godbole, Nicholas Monath, Seungyeon Kim, Ankit Singh Rawat, Andrew McCallum

SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documents

Qi Zhang, Zhijia Chen, Huitong Pan, Cornelia Caragea, Longin Jan Latecki

AnaloBench: Benchmarking the Identification of Abstract and Long-context Analogies

Xiao Ye, Andrew Wang, Jacob Choi, Yining Lu, Shreya Sharma

OATH-Frames: Characterizing Online Attitudes Towards Homelessness with LLM Assistants

Jaspreet Ranjit, Brihi Joshi, Rebecca Dorn, Laura Petry, Olga Koumoundouros

Story Morals: Surfacing value-driven narrative schemas using large language models

David G Hobson, Haiqi Zhou, Derek Ruths, Andrew Piper

UNICORN: A Unified Causal Video-Oriented Language-Modeling Framework for Temporal Video-Language Tasks

Yuanhao Xiong, Yixin Nie, Haotian Liu, Boxin Wang, Jun Chen

CoGen: Learning from Feedback with Coupled Comprehension and Generation

Mustafa Omer Gul, Yoav Artzi

SPEED++: A Multilingual Event Extraction Framework for Epidemic Prediction and Preparedness

Tanmay Parekh, Jeffrey Kwan, Jiarui Yu, Sparsh Johri, Hyosang Ahn

Target-Aware Language Modeling via Granular Data Sampling

Ernie Chang, Pin-Jie Lin, Yang Li, Changsheng Zhao, Daeil Kim

Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

Yixuan Wang, Xianzhen Luo, Fuxuan Wei, Yijun Liu, Qingfu Zhu

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models

Yae Jee Cho, Luyang Liu, Zheng Xu, Aldi Fahrezi, Gauri Joshi

Defending Against Social Engineering Attacks in the Age of LLMs

Lin Ai, Tharindu Sandaruwan Kumarage, Amrita Bhattacharjee, Zizhou Liu, Zheng Hui

Learning to Write Rationally: How Information Is Distributed in Non-native Speakers’ Essays

Zixin Tang, Janet G. van Hell

Large Language Models Can Self-Correct with Key Condition Verification

Zhenyu Wu, Qingkai Zeng, Zhihan Zhang, Zhaoxuan Tan, Chao Shen

ModSCAN: Measuring Stereotypical Bias in Large Vision-Language Models from Vision and Language Modalities

Yukun Jiang, Zheng Li, Xinyue Shen, Yugeng Liu, Michael Backes

DKEC: Domain Knowledge Enhanced Multi-Label Classification for Diagnosis Prediction

Xueren Ge, Abhishek Satpathy, Ronald Dean Williams, John Stankovic, Homa Alemzadeh

PATIENT-𝜓: Using Large Language Models to Simulate Patients for Training Mental Health Professionals

Ruiyi Wang, Stephanie Milani, Jamie C. Chiu, Jiayin Zhi, Shaun M. Eack