ACL 2024

2,718 papers

PRewrite: Prompt Rewriting with Reinforcement Learning

Weize Kong, Spurthi Hombaiah, Mingyang Zhang, Qiaozhu Mei, Michael Bendersky

Time Sensitive Knowledge Editing through Efficient Finetuning

Xiou Ge, Ali Mousavi, Edouard Grave, Armand Joulin, Kun Qian

ConstitutionalExperts: Training a Mixture of Principle-based Prompts

Savvas Petridis, Ben Wedin, Ann Yuan, James Wexler, Nithum Thain

Are LLMs classical or nonmonotonic reasoners? Lessons from generics

Alina Leidinger, Robert Van Rooij, Ekaterina Shutova

Naming, Describing, and Quantifying Visual Objects in Humans and LLMs

Alberto Testoni, Juell Sprott, Sandro Pezzelle

The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Models

Noah Siegel, Oana-Maria Camburu, Nicolas Heess, Maria Perez-Ortiz

Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research

Surangika Ranathunga, Nisansa de Silva, Dilith Jayakody, Aloka Fernando

AGR: Reinforced Causal Agent-Guided Self-explaining Rationalization

Yunxiao Zhao, Zhiqiang Wang, Xiaoli Li, Jiye Liang, Ru Li

IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages

Saiful Haq, Ashutosh Sharma, Omar Khattab, Niyati Chhaya, Pushpak Bhattacharyya

Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains

Vilém Zouhar, Shuoyang Ding, Anna Currey, Tatyana Badeka, Jenyuan Wang

An Empirical Analysis on Large Language Models in Debate Evaluation

Xinyi Liu, Pinxin Liu, Hangfeng He

MaskLID: Code-Switching Language Identification through Iterative Masking

Amir Hossein Kargaran, François Yvon, Hinrich Schuetze

DocFinQA: A Long-Context Financial Reasoning Dataset

Varshini Reddy, Rik Koncel-Kedziorski, Viet Dac Lai, Michael Krumdick, Charles Lovering

STREAM: Simplified Topic Retrieval, Exploration, and Analysis Module

Anton Frederik Thielmann, Arik Reuter, Benjamin Säfken, Christoph Weisser, Manish Kumar

Sign Language Translation with Sentence Embedding Supervision

Yasser Hamidullah, Josef van Genabith, Cristina España-Bonet

Born Differently Makes a Difference: Counterfactual Study of Bias in Biography Generation from a Data-to-Text Perspective

Biaoyan Fang, Ritvik Dinesh, Xiang Dai, Sarvnaz Karimi

Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster

Agostina Calabrese, Leonardo Neves, Neil Shah, Maarten Bos, Bjorn Ross

Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender?

Haozhe An, Christabel Acquaye, Colin Wang, Zongxia Li, Rachel Rudinger

That’s Optional: A Contemporary Exploration of “that” Omission in English Subordinate Clauses

Ella Rabinovich

Dwell in the Beginning: How Language Models Embed Long Documents for Dense Retrieval

João Coelho, Bruno Martins, Joao Magalhaes, Jamie Callan, Chenyan Xiong

Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmark

Niklas Wretblad, Fredrik Riseby, Rahul Biswas, Amin Ahmadi, Oskar Holmström

EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models

Mengfei Du, Binhao Wu, Zejun Li, Xuanjing Huang, zhongyu wei

ATLAS: Improving Lay Summarisation with Attribute-based Control

Zhihao Zhang, Tomas Goldsack, Carolina Scarton, Chenghua Lin

What Does Parameter-free Probing Really Uncover?

Tommi Buder-Gröndahl

MTP: A Dataset for Multi-Modal Turning Points in Casual Conversations

Gia-Bao Ho, Chang Tan, Zahra Darban, Mahsa Salehi, Reza Haf

RecGPT: Generative Pre-training for Text-based Recommendation

Hoang Ngo, Dat Quoc Nguyen

Soft Self-Consistency Improves Language Models Agents

Han Wang, Archiki Prasad, Elias Stengel-Eskin, Mohit Bansal

Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing

Shafiuddin Rehan Ahmed, Zhiyong Eric Wang, George Arthur Baker, Kevin Stowe, James H. Martin

Is the Pope Catholic? Yes, the Pope is Catholic. Generative Evaluation of Non-Literal Intent Resolution in LLMs

Akhila Yerukola, Saujas Vaduguru, Daniel Fried, Maarten Sap

Learnable Privacy Neurons Localization in Language Models

Ruizhe Chen, Tianxiang Hu, Yang Feng, Zuozhu Liu

On the Semantic Latent Space of Diffusion-Based Text-To-Speech Models

Miri Varshavsky-Hassid, Roy Hirsch, Regev Cohen, Tomer Golany, Daniel Freedman

Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access

Saibo Geng, Berkay Döner, Chris Wendler, Martin Josifoski, Robert West

Growing Trees on Sounds: Assessing Strategies for End-to-End Dependency Parsing of Speech

Adrien Pupier, Maximin Coavoux, Jérôme Goulian, Benjamin Lecouteux

Fine-Tuning Pre-Trained Language Models with Gaze Supervision

Shuwen Deng, Paul Prasse, David Reich, Tobias Scheffer, Lena Jäger

DynaSemble: Dynamic Ensembling of Textual and Structure-Based Models for Knowledge Graph Completion

Ananjan Nandi, Navdeep Kaur, Parag Singla, Mausam .

Two Issues with Chinese Spelling Correction and A Refinement Solution

Changxuan Sun, Linlin She, Xuesong Lu

Monotonic Representation of Numeric Attributes in Language Models

Benjamin Heinzerling, Kentaro Inui

DDPrompt: Differential Diversity Prompting in Large Language Models

Lin Mu, Wenhao Zhang, Yiwen Zhang, Peiquan Jin

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models

Zeyu Liu, Souvik Kundu, Anni Li, Junrui Wan, Lianghao Jiang

Code-Switching Can be Better Aligners: Advancing Cross-Lingual SLU through Representation-Level and Prediction-Level Alignment

Zhihong Zhu, Xuxin Cheng, Zhanpeng Chen, Xianwei Zhuang, Zhiqi Huang

Bi-Directional Multi-Granularity Generation Framework for Knowledge Graph-to-Text with Large Language Model

Haowei Du, Chen Li, Dinghao Zhang, Dongyan Zhao

IEPile: Unearthing Large Scale Schema-Conditioned Information Extraction Corpus

Honghao Gui, Lin Yuan, Hongbin Ye, Ningyu Zhang, Mengshu Sun

On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models

Dongyang Li, Junbing Yan, Taolin Zhang, Chengyu Wang, Xiaofeng He

SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark

Zhenwen Liang, kehan Guo, Gang Liu, Taicheng Guo, Yujun Zhou

UltraSparseBERT: 99% Conditionally Sparse Language Modelling

Peter Belcak, Roger Wattenhofer

Simpson’s Paradox and the Accuracy-Fluency Tradeoff in Translation

Zheng Wei Lim, Ekaterina Vylomova, Trevor Cohn, Charles Kemp

Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks

Andrew Gambardella, Yusuke Iwasawa, Yutaka Matsuo

Isotropy, Clusters, and Classifiers

Timothee Mickus, Stig-Arne Grönroos, Joseph Attieh

RDRec: Rationale Distillation for LLM-based Recommendation

Xinfeng Wang, Jin Cui, Yoshimi Suzuki, Fumiyo Fukumoto

Speculative Contrastive Decoding

Hongyi Yuan, Keming Lu, Fei Huang, Zheng Yuan, Chang Zhou

Resisting the Lure of the Skyline: Grounding Practices in Active Learning for Morphological Inflection

Saliha Muradoglu, Michael Ginn, Miikka Silfverberg, Mans Hulden

Revisiting Code Similarity Evaluation with Abstract Syntax Tree Edit Distance

Yewei Song, Cedric Lothritz, Daniel Tang, Tegawendé Bissyandé, Jacques Klein

FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language Models

Andrew Zhu, Alyssa Hwang, Liam Dugan, Chris Callison-Burch

Can Language Models Serve as Text-Based World Simulators?

Ruoyao Wang, Graham Todd, Ziang Xiao, Xingdi Yuan, Marc-Alexandre Côté

Word Embeddings Are Steers for Language Models

Chi Han, Jialiang Xu, Manling Li, Yi Fung, Chenkai Sun

Explicating the Implicit: Argument Detection Beyond Sentence Boundaries

Paul Roit, Aviv Slobodkin, Eran Hirsch, Arie Cattan, Ayal Klein

Having Beer after Prayer? Measuring Cultural Bias in Large Language Models

Tarek Naous, Michael J Ryan, Alan Ritter, Wei Xu

ECBD: Evidence-Centered Benchmark Design for NLP

Yu Lu Liu, Su Lin Blodgett, Jackie Cheung, Q. Vera Liao, Alexandra Olteanu

Let’s Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation

Se Park, Chae Kim, Hyeongseop Rha, Minsu Kim, Joanna Hong

LooGLE: Can Long-Context Language Models Understand Long Contexts?

Jiaqi Li, Mengmeng Wang, Zilong Zheng, Muhan Zhang

The Earth is Flat because...: Investigating LLMs’ Belief towards Misinformation via Persuasive Conversation

Rongwu Xu, Brian Lin, Shujian Yang, Tianqi Zhang, Weiyan Shi

NounAtlas: Filling the Gap in Nominal Semantic Role Labeling

Roberto Navigli, Marco Lo Pinto, Pasquale Silvestri, Dennis Rotondi, Simone Ciciliano

Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!

Stefano Perrella, Lorenzo Proietti, Alessandro Scirè, Edoardo Barba, Roberto Navigli

MAP’s not dead yet: Uncovering true language model modes by conditioning away degeneracy

Davis Yoshida, Kartik Goyal, Kevin Gimpel

ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer

Arkadiy Saakyan, Smaranda Muresan

Unintended Impacts of LLM Alignment on Global Representation

Michael J Ryan, William Held, Diyi Yang

DocMath-Eval: Evaluating Math Reasoning Capabilities of LLMs in Understanding Long and Specialized Documents

Yilun Zhao, Yitao Long, Hongjun Liu, Ryo Kamoi, Linyong Nan

MMToM-QA: Multimodal Theory of Mind Question Answering

Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo

AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

Harsh Trivedi, Tushar Khot, Mareike Hartmann, Ruskin Manku, Vinty Dong

MultiPICo: Multilingual Perspectivist Irony Corpus

Silvia Casola, Simona Frenda, Soda Marem Lo, Erhan Sezerer, Antonio Uva

COKE: A Cognitive Knowledge Graph for Machine Theory of Mind

Jincenzi Wu, Zhuang Chen, Jiawen Deng, Sahand Sabour, Helen Meng

ToMBench: Benchmarking Theory of Mind in Large Language Models

Zhuang Chen, Jincenzi Wu, Jinfeng Zhou, Bosi Wen, Guanqun Bi

BatchEval: Towards Human-like Text Evaluation

Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Boyuan Pan

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model

Ahmet Üstün, Viraat Aryabumi, Zheng Yong, Wei-Yin Ko, Daniel D’souza

Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models

Xiaolong Wang, Yile Wang, Yuanchi Zhang, Fuwen Luo, Peng Li

IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages

Mohammed Safi Ur Rahman Khan, Priyam Mehta, Ananth Sankar, Umashankar Kumaravelan, Sumanth Doddapaneni

Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!

Zhanhui Zhou, Jie Liu, Zhichen Dong, Jiaheng Liu, Chao Yang

OLMo: Accelerating the Science of Language Models

Dirk Groeneveld, Iz Beltagy, Evan Walsh, Akshita Bhagia, Rodney Kinney

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson

American Sign Language Handshapes Reflect Pressures for Communicative Efficiency

Kayo Yin, Terry Regier, Dan Klein

EZ-STANCE: A Large Dataset for English Zero-Shot Stance Detection

Chenye Zhao, Cornelia Caragea

On Efficient and Statistical Quality Estimation for Data Annotation

Jan-Christoph Klie, Juan Haladjian, Marc Kirchner, Rahul Nair

Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model

Christian Tomani, David Vilar, Markus Freitag, Colin Cherry, Subhajit Naskar

CHECKWHY: Causal Fact Verification via Argument Structure

Jiasheng Si, Yibo Zhao, Yingjie Zhu, Haiyang Zhu, Wenpeng Lu

Causal Estimation of Memorisation Profiles

Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel

RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanization

Jaavid J, Raj Dabre, Aswanth M, Jay Gala, Thanmay Jayakumar

M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models

Wai-Chung Kwan, Xingshan Zeng, Yufei Wang, Yusen Sun, Liangyou Li

Deciphering Oracle Bone Language with Diffusion Models

Haisu Guan, Huanxin Yang, Xinyu Wang, Shengwei Han, Yongge Liu

SafetyBench: Evaluating the Safety of Large Language Models

Zhexin Zhang, Leqi Lei, Lindong Wu, Rui Sun, Yongkang Huang

EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities

Nian Li, Chen Gao, Mingyu Li, Yong Li, Qingmin Liao

Steering Llama 2 via Contrastive Activation Addition

Nina Rimsky, Nick Gabrieli, Julian Schulz, Meg Tong, Evan Hubinger

Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn’t

Chihiro Taguchi, David Chiang

Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement

Wenda Xu, Guanglei Zhu, Xuandong Zhao, Liangming Pan, Lei Li

Iterative Forward Tuning Boosts In-Context Learning in Language Models

Jiaxi Yang, Binyuan Hui, Min Yang, bailin wang, Bowen Li

Calibrating Large Language Models Using Their Generations Only

Dennis Ulmer, Martin Gubri, Hwaran Lee, Sangdoo Yun, Seong Oh

SPZ: A Semantic Perturbation-based Data Augmentation Method with Zonal-Mixing for Alzheimer’s Disease Detection

Fangfang Li, Cheng Huang, PuZhen Su, Jie Yin

Media Framing: A typology and Survey of Computational Approaches Across Disciplines

Yulia Otmakhova, Shima Khanehzar, Lea Frermann

G-DIG: Towards Gradient-based DIverse and hiGh-quality Instruction Data Selection for Machine Translation

Xingyuan Pan, Luyang Huang, Liyan Kang, Zhicheng Liu, Yu Lu

Do Llamas Work in English? On the Latent Language of Multilingual Transformers

Chris Wendler, Veniamin Veselovsky, Giovanni Monea, Robert West

Disambiguate Words like Composing Them: A Morphology-Informed Approach to Enhance Chinese Word Sense Disambiguation

Yue Wang, Qiliang Liang, Yaqi Yin, Hansi Wang, Yang Liu