EMNLP 2024

2,910 papers

Dual-Space Knowledge Distillation for Large Language Models

Songming Zhang, Xue Zhang, Zengkui Sun, Yufeng Chen, Jinan Xu

Why do objects have many names? A study on word informativeness in language use and lexical systems

Eleonora Gualdoni, Gemma Boleda

Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance?

Fumiya Uchiyama, Takeshi Kojima, Andrew Gambardella, Qi Cao, Yusuke Iwasawa

Calibrating Language Models with Adaptive Temperature Scaling

Johnathan Xie, Annie S Chen, Yoonho Lee, Eric Mitchell, Chelsea Finn

A Survey of Ontology Expansion for Conversational Understanding

Jinggui Liang, Yuxia Wu, Yuan Fang, Hao Fei, Lizi Liao

Revisiting the Robustness of Watermarking to Paraphrasing Attacks

Saksham Rastogi, Danish Pruthi

Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning

Abhinav Bandari, Lu Yin, Cheng-Yu Hsieh, Ajay Kumar Jaiswal, Tianlong Chen

Seg2Act: Global Context-aware Action Generation for Document Logical Structuring

Zichao Li, Shaojie He, Meng Liao, Xuanang Chen, Yaojie Lu

What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study

Beatrice Savoldi, Sara Papi, Matteo Negri, Ana Guerberof-Arenas, Luisa Bentivogli

Tree of Problems: Improving structured problem solving with compositionality

Armel Randy Zebaze, Benoît Sagot, Rachel Bawden

Quantum Recurrent Architectures for Text Classification

Wenduan Xu, Stephen Clark, Douglas Brown, Gabriel Matos, Konstantinos Meichanetzidis

Label Confidence Weighted Learning for Target-level Sentence Simplification

Xin Ying Qiu, Jingshen Zhang

Game on Tree: Visual Hallucination Mitigation via Coarse-to-Fine View Tree and Game Theory

Xianwei Zhuang, Zhihong Zhu, Zhanpeng Chen, Yuxin Xie, Liming Liang

Improving Zero-shot LLM Re-Ranker with Risk Minimization

Xiaowei Yuan, Zhao Yang, Yequan Wang, Jun Zhao, Kang Liu

In-Context Compositional Generalization for Large Vision-Language Models

Chuanhao Li, Chenchen Jing, Zhen Li, Mingliang Zhai, Yuwei Wu

PepRec: Progressive Enhancement of Prompting for Recommendation

Yakun Yu, Shi-ang Qi, Baochun Li, Di Niu

CURE: Context- and Uncertainty-Aware Mental Disorder Detection

Migyeong Kang, Goun Choi, Hyolim Jeon, Ji Hyun An, Daejin Choi

Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs

Xin Zhou, Ping Nie, Yiwen Guo, Haojie Wei, Zhanqiu Zhang

Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate

Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang

Automated Essay Scoring: A Reflection on the State of the Art

Shengjie Li, Vincent Ng

Data Contamination Can Cross Language Barriers

Feng Yao, Yufan Zhuang, Zihao Sun, Sunan Xu, Animesh Kumar

Unleashing the Power of Emojis in Texts via Self-supervised Graph Pre-Training

Zhou Zhang, Dongzeng Tan, Jiaan Wang, Yilong Chen, Jiarong Xu

Embedded Named Entity Recognition using Probing Classifiers

Nicholas Popovic, Michael Färber

Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging

Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang

From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichment

Yusuke Hirota, Ryo Hachiuma, Chao-Han Huck Yang, Yuta Nakashima

Enhancing Post-Hoc Attributions in Long Document Comprehension via Coarse Grained Answer Decomposition

Pritika Ramu, Koustava Goswami, Apoorv Saxena, Balaji Vasan Srinivasan

Knowledge Planning in Large Language Models for Domain-Aligned Counseling Summarization

Aseem Srivastava, Smriti Joshi, Tanmoy Chakraborty, Md Shad Akhtar

The Zeno’s Paradox of ‘Low-Resource’ Languages

Hellina Hailu Nigatu, Atnafu Lambebo Tonja, Benjamin Rosman, Thamar Solorio, Monojit Choudhury

Moral Foundations of Large Language Models

Marwa Abdulhai, Gregory Serapio-García, Clement Crepy, Daria Valter, John Canny

Searching for Best Practices in Retrieval-Augmented Generation

Xiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang, Yixin Wu

Can Large Language Models Enhance Predictions of Disease Progression? Investigating Through Disease Network Link Prediction

Haohui Lu, Usman Naseem

MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs

Yerin Hwang, Yongil Kim, Yunah Jang, Jeesoo Bang, Hyunkyung Bae

Are Large Language Models Capable of Generating Human-Level Narratives?

Yufei Tian, Tenghao Huang, Miri Liu, Derek Jiang, Alexander Spangher

Mentor-KD: Making Small Language Models Better Multi-step Reasoners

Hojae Lee, Junho Kim, SangKeun Lee

Don’t Forget Your Reward Values: Language Model Alignment via Value-based Calibration

Xin Mao, Feng-Lin Li, Huimin Xu, Wei Zhang, Wang Chen

LLoCO: Learning Long Contexts Offline

Sijun Tan, Xiuyu Li, Shishir G Patil, Ziyang Wu, Tianjun Zhang

Symbolic Working Memory Enhances Language Models for Complex Rule Application

Siyuan Wang, zhongyu wei, Yejin Choi, Xiang Ren

From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking

Siyuan Wang, Zhuohan Long, Zhihao Fan, zhongyu wei

Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection

Zhanpeng Chen, Zhihong Zhu, Xianwei Zhuang, Zhiqi Huang, Yuexian Zou

Zero-Shot Detection of LLM-Generated Text using Token Cohesiveness

Shixuan Ma, Quan Wang

Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs

Liu Ran, Zhongzhou Liu, Xiaoli Li, Yuan Fang

ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosures

Tobias Schimanski, Jingwei Ni, Roberto Spacey Martín, Nicola Ranger, Markus Leippold

CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference

Erxin Yu, Jing Li, Ming Liao, Siqi Wang, Gao Zuchen

Representational Analysis of Binding in Language Models

Qin Dai, Benjamin Heinzerling, Kentaro Inui

A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models

Houquan Zhou, Zhenghua Li, Bo Zhang, Chen Li, Shaopeng Lai

Information Flow Routes: Automatically Interpreting Language Models at Scale

Javier Ferrando, Elena Voita

Inductive-Deductive Strategy Reuse for Multi-Turn Instructional Dialogues

Jiao Ou, Jiayu Wu, Che Liu, Fuzheng Zhang, Di Zhang

Varying Sentence Representations via Condition-Specified Routers

Ziyong Lin, Quansen Wang, Zixia Jia, Zilong Zheng

MedCoT: Medical Chain of Thought via Hierarchical Expert

Jiaxiang Liu, Yuan Wang, JIAWEI DU, Joey Tianyi Zhou, Zuozhu Liu

StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children’s Story-Based Learning

Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong

FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization

Mingye Zhu, Yi Liu, Quan Wang, Junbo Guo, Zhendong Mao

MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification

Siddhant Bikram Shah, Shuvam Shiwakoti, Maheep Chaudhary, Haohan Wang

MedReadMe: A Systematic Study for Fine-grained Sentence Readability in Medical Domain

Chao Jiang, Wei Xu

Granular Privacy Control for Geolocation with Vision Language Models

Ethan Mendes, Yang Chen, James Hays, Sauvik Das, Wei Xu

Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations

Sagi Shaier, Ari Kobren, Philip V. Ogren

Fill In The Gaps: Model Calibration and Generalization with Synthetic Data

Yang Ba, Michelle V Mancenido, Rong Pan

Media Attitude Detection via Framing Analysis with Events and their Relations

Jin Zhao, Jingxuan Tu, Han Du, Nianwen Xue

Measuring Psychological Depth in Language Models

Fabrice Y Harel-Canada, Hanyu Zhou, Sreya Muppalla, Zeynep Senahan Yildiz, Miryung Kim

How Susceptible are Large Language Models to Ideological Manipulation?

Kai Chen, Zihao He, Jun Yan, Taiwei Shi, Kristina Lerman

GDPO: Learning to Directly Align Language Models with Diversity Using GFlowNets

Oh Joon Kwon, Daiki E. Matsunaga, Kee-eung Kim

Do LLMs learn a true syntactic universal?

John T. Hale, Miloš Stanojević

Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Tu Vu, Kalpesh Krishna, Salaheddin Alzubi, Chris Tar, Manaal Faruqui

One Thousand and One Pairs: A “novel” challenge for long-context language models

Marzena Karpinska, Katherine Thai, Kyle Lo, Tanya Goyal, Mohit Iyyer

Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models

Yuan-Hong Liao, Rafid Mahmood, Sanja Fidler, David Acuna

Mathador-LM: A Dynamic Benchmark for Mathematical Reasoning on Large Language Models

Eldar Kurtic, Amir Moeini, Dan Alistarh

Community-Cross-Instruct: Unsupervised Instruction Generation for Aligning Large Language Models to Online Communities

Zihao He, Minh Duc Chu, Rebecca Dorn, Siyi Guo, Kristina Lerman

On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning

Geewook Kim, Minjoon Seo

Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models

Mehrdad Farahani, Richard Johansson

LLM-based Code-Switched Text Generation for Grammatical Error Correction

Tom Potter, Zheng Yuan

FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping

Ajay Kumar Jaiswal, Bodun Hu, Lu Yin, Yeonju Ro, Tianlong Chen

LLM-Evolve: Evaluation for LLM’s Evolving Capability on Benchmarks

Jiaxuan You, Mingjie Liu, Shrimai Prabhumoye, Mostofa Patwary, Mohammad Shoeybi

RAFT: Realistic Attacks to Fool Text Detectors

James Liyuan Wang, Ran Li, Junfeng Yang, Chengzhi Mao

Working Memory Identifies Reasoning Limits in Language Models

Chunhui Zhang, Yiren Jian, Zhongyu Ouyang, Soroush Vosoughi

***YesBut***: A High-Quality Annotated Multimodal Dataset for evaluating Satire Comprehension capability of Vision-Language Models

Abhilash Nandy, Yash Agarwal, Ashish Patwa, Millon Madhur Das, Aman Bansal

MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations

Vishal Vivek Saley, Goonjan Saha, Rocktim Jyoti Das, Dinesh Raghu, Mausam .

Are Large Language Models In-Context Personalized Summarizers? Get an iCOPERNICUS Test Done!

Divya Patel, Pathik Patel, Ankush Chander, Sourish Dasgupta, Tanmoy Chakraborty

Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue

Jia-Chen Gu, Hao-Xiang Xu, Jun-Yu Ma, Pan Lu, Zhen-Hua Ling

Investigating Large Language Models for Complex Word Identification in Multilingual and Multidomain Setups

Răzvan-Alexandru Smădu, David-Gabriel Ion, Dumitru-Clementin Cercel, Florin Pop, Mihaela-Claudia Cercel

The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning

Shaobo Cui, Zhijing Jin, Bernhard Schölkopf, Boi Faltings

Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis

Amey Hengle, Atharva Kulkarni, Shantanu Deepak Patankar, Madhumitha Chandrasekaran, Sneha D’silva

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions

Clement Neo, Shay B Cohen, Fazl Barez

Small LLMs Are Weak Tool Learners: A Multi-LLM Agent

Weizhou Shen, Chenliang Li, Hongzhan Chen, Ming Yan, Xiaojun Quan

Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student Revisions

Inderjeet Jayakumar Nair, Jiaye Tan, Xiaotian Su, Anne Gere, Xu Wang

Explicit Memory Learning with Expectation Maximization

Zhangyue Yin, Qiushi Sun, Qipeng Guo, Zhiyuan Zeng, Qinyuan Cheng

SEGMENT+: Long Text Processing with Short-Context Language Models

Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang

BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training

Pavel Chizhov, Catherine Arnett, Elizaveta Korotkova, Ivan P. Yamshchikov

Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP

Omer Goldman, Alon Jacovi, Aviv Slobodkin, Aviya Maimon, Ido Dagan

Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization?

Jianfeng He, Runing Yang, Linlin Yu, Changbin Li, Ruoxi Jia

Multi-Level Information Retrieval Augmented Generation for Knowledge-based Visual Question Answering

Omar Adjali, Olivier Ferret, Sahar Ghannay, Herve Le Borgne

Towards a Similarity-adjusted Surprisal Theory

Clara Meister, Mario Giulianelli, Tiago Pimentel

LM2: A Simple Society of Language Models Solves Complex Reasoning

Gurusha Juneja, Subhabrata Dutta, Tanmoy Chakraborty

ATAP: Automatic Template-Augmented Commonsense Knowledge Graph Completion via Pre-Trained Language Models

Fu Zhang, Yifan Ding, Jingwei Cheng

Intrinsic Self-correction for Enhanced Morality: An Analysis of Internal Mechanisms and the Superficial Hypothesis

Guangliang Liu, Haitao Mao, Jiliang Tang, Kristen Johnson

Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards

Heejin Do, Sangwon Ryu, Gary Lee

Scaling Laws for Linear Complexity Language Models

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun

Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoning Through Trap Problems

Jun Zhao, Jingqi Tong, Yurong Mou, Ming Zhang, Qi Zhang

Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphs

Simone Conia, Daniel Lee, Min Li, Umar Farooq Minhas, Saloni Potdar

AutoPersuade: A Framework for Evaluating and Explaining Persuasive Arguments

Till Raphael Saenger, Musashi Hinck, Justin Grimmer, Brandon M. Stewart

LONGAGENT: Achieving Question Answering for 128k-Token-Long Documents through Multi-Agent Collaboration

Jun Zhao, Can Zu, Xu Hao, Yi Lu, Wei He

Finding Blind Spots in Evaluator LLMs with Interpretable Checklists

Sumanth Doddapaneni, Mohammed Safi Ur Rahman Khan, Sshubam Verma, Mitesh M Khapra