EMNLP 2024

2,910 papers

Learning to Adapt Large Language Models to One-Shot In-Context Intent Classification on Unseen Domains

Joongbo Shin, Youbin Ahn, Seungpil Won, Stanley Jungkyu Choi

Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge

Ravi Shanker Raju, Swayambhoo Jain, Bo Li, Jonathan Lingjie Li, Urmish Thakker

Trustful LLMs: Customizing and Grounding Text Generation with knowledge bases and Dual Decoders

Xiaofeng Zhu, Jaya Krishna Mandivarapu

Customized Style Transfer using Discrete Sampling

Anugunj Naman

Exploring the Readiness of Prominent Small Language Models for the Democratization of Financial Literacy

Tagore Rao Kosireddy, Jeffrey David Wall, Evan Lucas

Active Learning for Robust and Representative LLM Generation in Safety-Critical Scenarios

Sabit Hassan, Anthony Sicilia, Malihe Alikhani

CPS-TaskForge: Generating Collaborative Problem Solving Environments for Diverse Communication Tasks

Nikita Haduong, Irene Wang, Bo-Ru Lu, Prithviraj Ammanabrolu, Noah A. Smith

AdaptEval: Evaluating Large Language Models on Domain Adaptation for Text Summarization

Anum Afzal, Ribin Chalumattu, Florian Matthes, Laura Mascarell

Grounded Language Agent for Product Search via Intelligent Web Interactions

Moghis Fereidouni, Adib Mosharrof, A.b. Siddique

L3Masking: Multi-task Fine-tuning for Language Models by Leveraging Lessons Learned from Vanilla Models

Yusuke Kimura, Takahiro Komamizu, Kenji Hatano

Understanding Players as if They Are Talking to the Game in a Customized Language: A Pilot Study

Tianze Wang, Maryam Honarijahromi, Styliani Katsarou, Olga Mikheeva, Theodoros Panagiotakopoulos

Less is Fed More: Sparsity Reduces Feature Distortion in Federated Learning

Abhinav Rao, Aashiq Muhamed, Harshita Diddee

LLM-Based Robust Product Classification in Commerce and Compliance

Sina Gholamian, Gianfranco Romani, Bartosz Rudnikowicz, Stavroula Skylaki

Empowering AAC Users: A Systematic Integration of Personal Narratives with Conversational AI

Sayantan Pal, Souvik Das, Rohini Srihari, Jeff Higginborham, Jenna Bizovi

Navigate Complex Physical Worlds via Geometrically Constrained LLM

Yongqiang Huang, Wentao Ye, Liyao Li, Junbo Zhao

Multilingual coreference resolution as text generation

Natalia Skachkova

End-to-end Multilingual Coreference Resolution with Headword Mention Representation

Ondřej Pražák, Miloslav Konopík

CorPipe at CRAC 2024: Predicting Zero Mentions from Raw Text

Milan Straka

Findings of the Third Shared Task on Multilingual Coreference Resolution

Michal Novák, Barbora Dohnalová, Miloslav Konopík, Anna Nedoluzhko, Martin Popel

DeepHCoref: A Deep Neural Coreference Resolution for Hindi Text

Kusum Lata, Pardeep Singh, Kamlesh Dutta, Abhishek Kanwar

WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case

Vagrant Gautam, Julius Steuer, Eileen Bingert, Ray Johns, Anne Lauscher

Unifying the Scope of Bridging Anaphora Types in English: Bridging Annotations in ARRAU and GUM

Lauren Levine, Amir Zeldes

MSCAW-coref: Multilingual, Singleton and Conjunction-Aware Word-Level Coreference Resolution

Houjun Liu, John Bauer, Karel D’Oosterlinck, Christopher Potts, Christopher D. Manning

Polish Coreference Corpus as an LLM Testbed: Evaluating Coreference Resolution within Instruction-Following Language Models by Instruction–Answer Alignment

Karol Saputa, Angelika Peljak-Łapińska, Maciej Ogrodniczuk

Enriching Conceptual Knowledge in Language Models through Metaphorical Reference Explanation

Zixuan Zhang, Heng Ji

Probing Language Models on Their Knowledge Source

Zineddine Tighidet, Jiali Mei, Benjamin Piwowarski, Patrick Gallinari

Multi-property Steering of Large Language Models with Dynamic Activation Composition

Daniel Scalena, Gabriele Sarti, Malvina Nissim

Wrapper Boxes for Faithful Attribution of Model Predictions to Training Data

Yiheng Su, Junyi Jessy Li, Matthew Lease

Accelerating Sparse Autoencoder Training via Layer-Wise Transfer Learning in Large Language Models

Davide Ghilardi, Federico Belotti, Marco Molinari, Jaehyuk Lim

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates

Yusuke Sakai, Adam Nohejl, Jiangnan Hang, Hidetaka Kamigaito, Taro Watanabe

Mechanistic?

Naomi Saphra, Sarah Wiegreffe

Investigating Layer Importance in Large Language Models

Yang Zhang, Yanfei Dong, Kenji Kawaguchi

Counterfactuals As a Means for Evaluating Faithfulness of Attribution Methods in Autoregressive Language Models

Sepehr Kamahi, Yadollah Yaghoobzadeh

IvRA: A Framework to Enhance Attention-Based Explanations for Language Models with Interpretability-Driven Training

Sean Xie, Soroush Vosoughi, Saeed Hassanpour

Pruning for Protection: Increasing Jailbreak Resistance in Aligned LLMs Without Fine-Tuning

Adib Hasan, Ileana Rugina, Alex Wang

Attribution Patching Outperforms Automated Circuit Discovery

Aaquib Syed, Can Rager, Arthur Conmy

Do Metadata and Appearance of the Retrieved Webpages Affect LLM’s Reasoning in Retrieval-Augmented Generation?

Cheng-Han Chiang, Hung-yi Lee

WellDunn: On the Robustness and Explainability of Language Models and Large Language Models in Identifying Wellness Dimensions

Seyedali Mohammadi, Edward Raff, Jinendra Malekar, Vedant Palit, Francis Ferraro

Copy Suppression: Comprehensively Understanding a Motif in Language Model Attention Heads

Callum Stuart McDougall, Arthur Conmy, Cody Rushing, Thomas McGrath, Neel Nanda

How Language Models Prioritize Contextual Grammatical Cues?

Hamidreza Amirzadeh, Afra Alishahi, Hosein Mohebbi

Self-Assessment Tests are Unreliable Measures of LLM Personality

Akshat Gupta, Xiaoyang Song, Gopala Anumanchipalli

Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2

Tom Lieberum, Senthooran Rajamanoharan, Arthur Conmy, Lewis Smith, Nicolas Sonnerat

Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Models

Carina Kauf, Emmanuele Chersoni, Alessandro Lenci, Evelina Fedorenko, Anna A Ivanova

Recurrent Neural Networks Learn to Store and Generate Sequences using Non-Linear Representations

Róbert Csordás, Christopher Potts, Christopher D Manning, Atticus Geiger

Uncovering Syllable Constituents in the Self-Attention-Based Speech Representations of Whisper

Erfan A Shams, Iona Gessinger, Julie Carson-berndsen

An Adversarial Example for Direct Logit Attribution: Memory Management in GELU-4L

Jett Janiak, Can Rager, James Dao, Yeu-Tong Lau

On the alignment of LM language generation and human language comprehension

Lena Sophia Bolliger, Patrick Haller, Lena Ann Jäger

Transformers Learn Transition Dynamics when Trained to Predict Markov Decision Processes

Yuxi Chen, Suwei Ma, Tony Dear, Xu Chen

Faithfulness and the Notion of Adversarial Sensitivity in NLP Explanations

Supriya Manna, Niladri Sett

Enhancing Question Answering on Charts Through Effective Pre-training Tasks

Ashim Gupta, Vivek Gupta, Shuo Zhang, Yujie He, Ning Zhang

Attend First, Consolidate Later: On the Importance of Attention in Different LLM Layers

Amit Ben Artzy, Roy Schwartz

Can We Statically Locate Knowledge in Large Language Models? Financial Domain and Toxicity Reduction Case Studies

Jordi Armengol-Estapé, Lingyu Li, Sebastian Gehrmann, Achintya Gopal, David S Rosenberg

MultiContrievers: Analysis of Dense Retrieval Representations

Seraphina Goldfarb-Tarrant, Pedro Rodriguez, Jane Dwivedi-Yu, Patrick Lewis

Enhancing adversarial robustness in Natural Language Inference using explanations

Alexandros Koulakos, Maria Lymperaiou, Giorgos Filandrianos, Giorgos Stamou

LLM Internal States Reveal Hallucination Risk Faced With a Query

Ziwei Ji, Delong Chen, Etsuko Ishii, Samuel Cahyawijaya, Yejin Bang

Language Models Linearly Represent Sentiment

Curt Tigges, Oskar J. Hollinsworth, Atticus Geiger, Neel Nanda

Learning, Forgetting, Remembering: Insights From Tracking LLM Memorization During Training

Danny D. Leybzon, Corentin Kervadec

Are there identifiable structural parts in the sentence embedding whole?

Vivi Nastase, Paola Merlo

Routing in Sparsely-gated Language Models responds to Context

Stefan Arnold, Marian Fietta, Dilara Yesilbas

Optimal and efficient text counterfactuals using Graph Neural Networks

Dimitris Lymperopoulos, Maria Lymperaiou, Giorgos Filandrianos, Giorgos Stamou

To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity

Anastasiia Sedova, Robert Litschko, Diego Frassinelli, Benjamin Roth, Barbara Plank

Stochastic Fine-Tuning of Language Models Using Masked Gradients

Mohammad Akbar-Tajari, Mohammad Taher Pilehvar

ATQ: Activation Transformation forWeight-Activation Quantization of Large Language Models

Yundong Gai, Ping Li

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging

Anton Alexandrov, Veselin Raychev, Mark Niklas Müller, Ce Zhang, Martin Vechev

Unified Active Retrieval for Retrieval Augmented Generation

Qinyuan Cheng, Xiaonan Li, Shimin Li, Qin Zhu, Zhangyue Yin

Dial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuning

Evgeniia Razumovskaia, Ivan Vulić, Pavle Marković, Tomasz Cichy, Qian Zheng

Efficient and Interpretable Grammatical Error Correction with Mixture of Experts

Muhammad Reza Qorib, Alham Fikri Aji, Hwee Tou Ng

PythonSaga: Redefining the Benchmark to Evaluate Code Generating LLMs

Ankit Yadav, Himanshu Beniwal, Mayank Singh

LLM Tropes: Revealing Fine-Grained Values and Opinions in Large Language Models

Dustin Wright, Arnav Arora, Nadav Borenstein, Srishti Yadav, Serge Belongie

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning

Jingfan Zhang, Yi Zhao, Dan Chen, Xing Tian, Huanran Zheng

CROWD: Certified Robustness via Weight Distribution for Smoothed Classifiers against Backdoor Attack

Siqi Sun, Procheta Sen, Wenjie Ruan

Robust AI-Generated Text Detection by Restricted Embeddings

Kristian Kuznetsov, Eduard Tulchinskii, Laida Kushnareva, German Magai, Serguei Barannikov

Zero-Shot Fact Verification via Natural Logic and Large Language Models

Marek Strong, Rami Aly, Andreas Vlachos

Improving Adversarial Robustness in Vision-Language Models with Architecture and Prompt Design

Rishika Bhagwatkar, Shravan Nayak, Pouya Bashivan, Irina Rish

BiMediX: Bilingual Medical Mixture of Experts LLM

Sara Pieri, Sahal Shaji Mullappilly, Fahad Shahbaz Khan, Rao Muhammad Anwer, Salman Khan

When Compression Meets Model Compression: Memory-Efficient Double Compression for Large Language Models

Weilan Wang, Yu Mao, Tang Dongdong, Du Hongchao, Nan Guan

Block-Diagonal Orthogonal Relation and Matrix Entity for Knowledge Graph Embedding

Yihua Zhu, Hidetoshi Shimodaira

Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answering

Zimu Wang, Lei Xia, Wei Wang, Xinya Du

Towards One-to-Many Visual Question Answering

Huishan Ji, Qingyi Si, Zheng Lin, Yanan Cao, Weiping Wang

SedarEval: Automated Evaluation using Self-Adaptive Rubrics

Zhiyuan Fan, Weinong Wang, Xing W, Debing Zhang

PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness

Noah Wang, Feiyu Duan, Yibo Zhang, Wangchunshu Zhou, Ke Xu

EmbodiedBERT: Cognitively Informed Metaphor Detection Incorporating Sensorimotor Information

Yu Xi Li, Bo Peng, Yu-Yin Hsu, Chu-Ren Huang

MedLogic-AQA: Enhancing Medicare Question Answering with Abstractive Models Focusing on Logical Structures

Aizan Zafar, Kshitij Mishra, Asif Ekbal

Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than-Two Unknowns?

Kuei-Chun Kao, Ruochen Wang, Cho-jui Hsieh

Personalized Video Comment Generation

Xudong Lin, Ali Zare, Shiyuan Huang, Ming-Hsuan Yang, Shih-fu Chang

Uncertainty Calibration for Tool-Using Language Agents

Hao Liu, Zi-Yi Dou, Yixin Wang, Nanyun Peng, Yisong Yue

Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths

Yew Ken Chia, Guizhen Chen, Weiwen Xu, Anh Tuan Luu, Soujanya Poria

Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper

Iuliia Thorbecke, Juan Pablo Zuluaga Gomez, Esau Villatoro-tello, Shashi Kumar, Pradeep Rangappa

TransferCVLM: Transferring Cross-Modal Knowledge for Vision-Language Modeling

Dongha Choi, Jung-jae Kim, Hyunju Lee

Fine-Tuning Language Models on Multiple Datasets for Citation Intention Classification

Zeren Shui, Petros Karypis, Daniel S. Karls, Mingjian Wen, Saurav Manchanda

Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness

Srija Mukhopadhyay, Adnan Qidwai, Aparna Garimella, Pritika Ramu, Vivek Gupta

ValueScope: Unveiling Implicit Norms and Values via Return Potential Model of Social Interactions

Chan Young Park, Shuyue Stella Li, Hayoung Jung, Svitlana Volkova, Tanu Mitra

Look Who’s Talking Now: Covert Channels From Biased LLMs

Daniel Silva, Frederic Sala, Ryan Gabrys

ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information

Zheng Hui, Zhaoxiao Guo, Hang Zhao, Juanyong Duan, Congrui Huang

Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization

Yu-Min Tseng, Yu-Chao Huang, Teng-Yun Hsiao, Wei-Lin Chen, Chao-Wei Huang

Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answering

Jiuheng Lin, Yuxuan Lai, Yansong Feng

TRIP NEGOTIATOR: A Travel Persona-aware Reinforced Dialogue Generation Model for Personalized Integrative Negotiation in Tourism

Priyanshu Priya, Desai Vishesh Yasheshbhai, Ratnesh Kumar Joshi, Roshni Ramnani, Anutosh Maitra

P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains

Simeng Han, Aaron Yu, Rui Shen, Zhenting Qi, Martin Riddell

See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning

Chengxin Zheng, Junzhong Ji, Yanzhao Shi, Xiaodan Zhang, Liangqiong Qu

Auto-Intent: Automated Intent Discovery and Self-Exploration for Large Language Model Web Agents

Jaekyeom Kim, Dong-Ki Kim, Lajanugen Logeswaran, Sungryull Sohn, Honglak Lee