EMNLP 2024

2,910 papers

WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language Models

Prannaya Gupta, Le Qi Yau, Hao Han Low, I-Shiang Lee, Hugo Maximus Lim

Generative Dictionary: Improving Language Learner Understanding with Contextual Definitions

Kai-Wen Tuan, Hai-Lun Tu, Jason S. Chang

SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model

Dayong Wu, Jiaqi Li, Baoxin Wang, Honghong Zhao, Siyuan Xue

Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play

Sha Li, Revanth Gangi Reddy, Khanh Duy Nguyen, Qingyun Wang, Yi Fung

Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks

Konstantin Grotov, Artem Borzilov, Maksim Krivobok, Timofey Bryksin, Yaroslav Zharov

mbrs: A Library for Minimum Bayes Risk Decoding

Hiroyuki Deguchi, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

Translation Canvas: An Explainable Interface to Pinpoint and Analyze Translation Systems

Chinmay Dandekar, Wenda Xu, Xi Xu, Siqi Ouyang, Lei Li

LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection

Mervat Abassy, Kareem Elozeiri, Alexander Aziz, Minh Ngoc Ta, Raj Vardhan Tomar

PyMarian: Fast Neural Machine Translation and Evaluation in Python

Thamme Gowda, Roman Grundkiewicz, Elijah Rippeth, Matt Post, Marcin Junczys-Dowmunt

RAGViz: Diagnose and Visualize Retrieval-Augmented Generation

Tevin Wang, Jingyuan He, Chenyan Xiong

ClaimLens: Automated, Explainable Fact-Checking on Voting Claims Using Frame-Semantics

Jacob Devasier, Rishabh Mediratta, Phuong Anh Le, David Huang, Chengkai Li

RETAIN: Interactive Tool for Regression Testing Guided LLM Migration

Tanay Dixit, Daniel Lee, Sally Fang, Sai Sree Harsha, Anirudh Sureshan

Xinference: Making Large Model Serving Easy

Weizheng Lu, Lingfeng Xiong, Feng Zhang, Xuye Qin, Yueguo Chen

KMatrix: A Flexible Heterogeneous Knowledge Enhancement Toolkit for Large Language Model

Shun Wu, Di Wu, Kun Luo, XueYou Zhang, Jun Zhao

ChatHF: Collecting Rich Human Feedback from Real-time Conversations

Andrew Li, Zhenduo Wang, Ethan Mendes, Duong Minh Le, Wei Xu

OpenT2T: An Open-Source Toolkit for Table-to-Text Generation

Haowei Zhang, Shengyun Si, Yilun Zhao, Lujing Xie, Zhijian Xu

MATSA: Multi-Agent Table Structure Attribution

Puneet Mathur, Alexa Siu, Nedim Lipka, Tong Sun

To the Globe (TTG): Towards Language-Driven Guaranteed Travel Planning

Da JU, Song Jiang, Andrew Cohen, Aaron Foss, Sasha Mitts

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

OpenFactCheck: A Unified Framework for Factuality Evaluation of LLMs

Hasan Iqbal, Yuxia Wang, Minghan Wang, Georgi Nenkov Georgiev, Jiahui Geng

OpenResearcher: Unleashing AI for Accelerated Scientific Research

Yuxiang Zheng, Shichao Sun, Lin Qiu, Dongyu Ru, Cheng Jiayang

TAIL: A Toolkit for Automatic and Realistic Long-Context Large Language Model Evaluation

Gefei Gu, Yilun Zhao, Ruoxi Ning, Yanan Zheng, Arman Cohan

WebOlympus: An Open Platform for Web Agents on Live Websites

Boyuan Zheng, Boyu Gou, Scott Salisbury, Zheng Du, Huan Sun

sign.mt: Real-Time Multilingual Sign Language Translation Application

Amit Moryossef

BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysis

Shuhang Lin, Wenyue Hua, Lingyao Li, Che-Jui Chang, Lizhou Fan

ReDel: A Toolkit for LLM-Powered Recursive Multi-Agent Systems

Andrew Zhu, Liam Dugan, Chris Callison-Burch

CAVA: A Tool for Cultural Alignment Visualization & Analysis

Nevan Giuliani, Cheng Charles Ma, Prakruthi Pradeep, Daphne Ippolito

Monitoring Hate Speech in Indonesia: An NLP-based Classification of Social Media Texts

Musa Izzanardi Wijanarko, Lucky Susanto, Prasetia Anugrah Pratama, Ika Karlina Idris, Traci Hong

TransAgents: Build Your Translation Company with Language Agents

Minghao Wu, Jiahao Xu, Longyue Wang

Arxiv Copilot: A Self-Evolving and Efficient LLM System for Personalized Academic Assistance

Guanyu Lin, Tao Feng, Pengrui Han, Ge Liu, Jiaxuan You

Integrating INCEpTION into larger annotation processes

Richard Eckart de Castilho, Jan-Christoph Klie, Iryna Gurevych

Commentator: A Code-mixed Multilingual Text Annotation Framework

Rajvee Sheth, Shubh Nisar, Heenaben Prajapati, Himanshu Beniwal, Mayank Singh

TruthReader: Towards Trustworthy Document Assistant Chatbot with Reliable Attribution

Dongfang Li, Xinshuo Hu, Zetian Sun, Baotian Hu, Shaolin Ye

TinyAgent: Function Calling at the Edge

Lutfi Eren Erdogan, Nicholas Lee, Siddharth Jha, Sehoon Kim, Ryan Tabrizi

AUTOGEN STUDIO: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems

Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney

MarkLLM: An Open-Source Toolkit for LLM Watermarking

Leyi Pan, Aiwei Liu, Zhiwei He, Zitian Gao, Xuandong Zhao

Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection

Taichi Nishimura, Shota Nakada, Hokuto Munakata, Tatsuya Komatsu

OpenOmni: A Collaborative Open Source Tool for Building Future-Ready Multimodal Conversational Agents

Qiang Sun, Yuanyi Luo, Sirui Li, Wenxiao Zhang, Wei Liu

Medico: Towards Hallucination Detection and Correction with Multi-source Evidence Fusion

Xinping Zhao, Jindi Yu, Zhenyu Liu, Jifang Wang, Dongfang Li

Evalverse: Unified and Accessible Library for Large Language Model Evaluation

Jihoo Kim, Wonho Song, Dahyun Kim, Yunsu Kim, Yungi Kim

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant

FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models

Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Zhengran Zeng

Entity Insertion in Multilingual Linked Corpora: The Case of Wikipedia

Tomás Feith, Akhil Arora, Martin Gerlach, Debjit Paul, Robert West

Instruction Fine-Tuning: Does Prompt Loss Matter?

Mathew Huerta-Enochian, Seung Yong Ko

Filtered Direct Preference Optimization

Tetsuro Morimura, Mitsuki Sakamoto, Yuu Jinnai, Kenshi Abe, Kaito Ariu

ALVIN: Active Learning Via INterpolation

Michalis Korakakis, Andreas Vlachos, Adrian Weller

Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes

Kosuke Nishida, Kyosuke Nishida, Kuniko Saito

Mitigating Open-Vocabulary Caption Hallucinations

Assaf Ben-Kish, Moran Yanuka, Morris Alper, Raja Giryes, Hadar Averbuch-Elor

‘Quis custodiet ipsos custodes?’ Who will watch the watchmen? On Detecting AI-generated peer-reviews

Sandeep Kumar, Mohit Sahu, Vardhan Gacche, Tirthankar Ghosal, Asif Ekbal

Knowledge Graph Enhanced Large Language Model Editing

Mengqi Zhang, Xiaotian Ye, Qiang Liu, Pengjie Ren, Shu Wu

Context-aware Watermark with Semantic Balanced Green-red Lists for Large Language Models

Yuxuan Guo, Zhiliang Tian, Yiping Song, Tianlun Liu, Liang Ding

LongRAG: A Dual-Perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering

Qingfei Zhao, Ruobing Wang, Yukuo Cen, Daren Zha, Shicheng Tan

Rethinking Pragmatics in Large Language Models: Towards Open-Ended Evaluation and Preference Tuning

Shengguang Wu, Shusheng Yang, Zhenglun Chen, Qi Su

Nearest Neighbor Normalization Improves Multimodal Retrieval

Neil Chowdhury, Franklin Wang, Sumedh Shenoy, Douwe Kiela, Sarah Schwettmann

Deciphering Cognitive Distortions in Patient-Doctor Mental Health Conversations: A Multimodal LLM-Based Detection and Reasoning Framework

Gopendra Vikram Singh, Sai Vardhan Vemulapalli, Mauajama Firdaus, Asif Ekbal

Improving Minimum Bayes Risk Decoding with Multi-Prompt

David Heineman, Yao Dou, Wei Xu

Coffee-Gym: An Environment for Evaluating and Improving Natural Language Feedback on Erroneous Code

Hyungjoo Chae, Taeyoon Kwon, Seungjun Moon, Yongho Song, Dongjin Kang

Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models

Hyungjoo Chae, Yeonghyeon Kim, Seungone Kim, Kai Tzu-iunn Ong, Beong-woo Kwak

ABLE: Personalized Disability Support with Politeness and Empathy Integration

Kshitij Mishra, Manisha Burja, Asif Ekbal

ZEBRA: Zero-Shot Example-Based Retrieval Augmentation for Commonsense Question Answering

Francesco Maria Molfese, Simone Conia, Riccardo Orlando, Roberto Navigli

MIBench: Evaluating Multimodal Large Language Models over Multiple Images

Haowei Liu, Xi Zhang, Haiyang Xu, Yaya Shi, Chaoya Jiang

Training-free Deep Concept Injection Enables Language Models for Video Question Answering

Xudong Lin, Manling Li, Richard Zemel, Heng Ji, Shih-fu Chang

Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair

Yusuke Sakai, Mana Makinae, Hidetaka Kamigaito, Taro Watanabe

CELLO: Causal Evaluation of Large Vision-Language Models

Meiqi Chen, Bo Peng, Yan Zhang, Chaochao Lu

SimLLM: Detecting Sentences Generated by Large Language Models Using Similarity between the Generation and its Re-generation

Hoang-Quoc Nguyen-Son, Minh-Son Dao, Koji Zettsu

EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records

Wenqi Shi, Ran Xu, Yuchen Zhuang, Yue Yu, Jieyu Zhang

MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning

Wenqi Shi, Ran Xu, Yuchen Zhuang, Yue Yu, Haotian Sun

M3D: MultiModal MultiDocument Fine-Grained Inconsistency Detection

Chia-Wei Tang, Ting-Chih Chen, Kiet A. Nguyen, Kazi Sajeed Mehrab, Alvi Md Ishmam

Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval

Jonghyun Song, Cheyon Jin, Wenlong Zhao, Andrew McCallum, Jay-Yoon Lee

BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers

Ran Xu, Wenqi Shi, Yue Yu, Yuchen Zhuang, Yanqiao Zhu

On the Fragility of Active Learners for Text Classification

Abhishek Ghose, Emma Thuong Nguyen

Is This a Bad Table? A Closer Look at the Evaluation of Table Generation from Text

Pritika Ramu, Aparna Garimella, Sambaran Bandyopadhyay

Simul-MuST-C: Simultaneous Multilingual Speech Translation Corpus Using Large Language Model

Mana Makinae, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

Vatsal Gupta, Pranshu Pandya, Tushar Kataria, Vivek Gupta, Dan Roth

RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented Generation

Kiseung Kim, Jay-Yoon Lee

GPT-4 Jailbreaks Itself with Near-Perfect Success Using Self-Explanation

Govind Ramesh, Yao Dou, Wei Xu

M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought

Gitanjali Kumari, Kirtan Jain, Asif Ekbal

Inference Helps PLMs’ Conceptual Understanding: Improving the Abstract Inference Ability with Hierarchical Conceptual Entailment Graphs

Juncai Li, Ru Li, Xiaoli Li, Qinghua Chai, Jeff Z. Pan

RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference

Yige Xu, Xu Guo, Zhiwei Zeng, Chunyan Miao

Is Child-Directed Speech Effective Training Data for Language Models?

Steven Y. Feng, Noah D. Goodman, Michael C. Frank

The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead?

Alexander S. Choi, Syeda Sabrina Akter, JP Singh, Antonios Anastasopoulos

FOLIO: Natural Language Reasoning with First-Order Logic

Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell

Holistic Evaluation for Interleaved Text-and-Image Generation

Minqian Liu, Zhiyang Xu, Zihao Lin, Trevor Ashby, Joy Rimchala

The Death and Life of Great Prompts: Analyzing the Evolution of LLM Prompts from the Structural Perspective

Yihan Ma, Xinyue Shen, Yixin Wu, Boyang Zhang, Michael Backes

Style-Shifting Behaviour of the Manosphere on Reddit

Jai Aggarwal, Suzanne Stevenson

FairFlow: Mitigating Dataset Biases through Undecided Learning for Natural Language Understanding

Jiali Cheng, Hadi Amiri

The Greatest Good Benchmark: Measuring LLMs’ Alignment with Utilitarian Moral Dilemmas

Giovanni Franco Gabriel Marraffini, Andrés Cotton, Noe Fabian Hsueh, Axel Fridman, Juan Wisznia

xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics

Daniil Larionov, Mikhail Seleznyov, Vasiliy Viskov, Alexander Panchenko, Steffen Eger

Adversarial Text Generation using Large Language Models for Dementia Detection

Youxiang Zhu, Nana Lin, Kiran Sandilya Balivada, Daniel Haehn, Xiaohui Liang

Accurate and Data-Efficient Toxicity Prediction when Annotators Disagree

Harbani Jaggi, Kashyap Coimbatore Murali, Eve Fleisig, Erdem Biyik

Dynamic Rewarding with Prompt Optimization Enables Tuning-free Self-Alignment of Language Models

Somanshu Singla, Zhen Wang, Tianyang Liu, Abdullah Ashfaq, Zhiting Hu

Assessing and Verifying Task Utility in LLM-Powered Applications

Negar Arabzadeh, Siqing Huo, Nikhil Mehta, Qingyun Wu, Chi Wang

SpeechQE: Estimating the Quality of Direct Speech Translation

HyoJung Han, Kevin Duh, Marine Carpuat

T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings

Björn Deiseroth, Manuel Brack, Patrick Schramowski, Kristian Kersting, Samuel Weinbach

Do LLMs Plan Like Human Writers? Comparing Journalist Coverage of Press Releases with LLMs

Alexander Spangher, Nanyun Peng, Sebastian Gehrmann, Mark Dredze

Sprout: Green Generative AI with Carbon-Efficient LLM Inference

Baolin Li, Yankai Jiang, Vijay Gadepally, Devesh Tiwari

RECANTFormer: Referring Expression Comprehension with Varying Numbers of Targets

Bhathiya Hemanthage, Hakan Bilen, Phil Bartie, Christian Dondrup, Oliver Lemon

Communicating with Speakers and Listeners of Different Pragmatic Levels

Kata Naszadi, Frans A Oliehoek, Christof Monz

Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activations

Rima Hazra, Sayan Layek, Somnath Banerjee, Soujanya Poria

Casablanca: Data and Models for Multidialectal Arabic Speech Recognition

Bashar Talafha, Karima Kadaoui, Samar Mohamed Magdy, Mariem Habiboullah, Chafei Mohamed Chafei