NAACL 2024

1,282 papers

Investigating Data Contamination in Modern Benchmarks for Large Language Models

Chunyuan Deng, Yilun Zhao, Xiangru Tang, Mark Gerstein, Arman Cohan

Tied-LoRA: Enhancing parameter efficiency of LoRA with Weight Tying

Adithya Renduchintala, Tugrul Konuk, Oleksii Kuchaiev

Keep it Private: Unsupervised Privatization of Online Text

Calvin Bao, Marine Carpuat

Hallucination Diversity-Aware Active Learning for Text Summarization

Yu Xia, Xu Liu, Tong Yu, Sungchul Kim, Ryan Rossi

On Learning to Summarize with Large Language Models as References

Yixin Liu, Kejian Shi, Katherine He, Longtian Ye, Alexander Fabbri

Large Human Language Models: A Need and the Challenges

Nikita Soni, H. Andrew Schwartz, João Sedoc, Niranjan Balasubramanian

Evaluating the Deductive Competence of Large Language Models

S Seals, Valerie Shalin

Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning

Xin Su, Tiep Le, Steven Bethard, Phillip Howard

Is Reference Necessary in the Evaluation of NLG Systems? When and Where?

Shuqian Sheng, Yi Xu, Luoyi Fu, Jiaxin Ding, Lei Zhou

X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects

Minqian Liu, Ying Shen, Zhiyang Xu, Yixin Cao, Eunah Cho

LegalDiscourse: Interpreting When Laws Apply and To Whom

Alexander Spangher, Zihan Xue, Te-Lin Wu, Mark Hansen, Jonathan May

Multilingual Models for ASR in Chibchan Languages

Rolando Coto-Solano, Tai Wan Kim, Alexander Jones, Sharid Loáiciga

To Tell The Truth: Language of Deception and Language Models

Sanchaita Hazra, Bodhisattwa Prasad Majumder

UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations

Wenting Zhao, Justin T. Chiu, Jena D. Hwang, Faeze Brahman, Jack Hessel

ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring

Shengjie Li, Vincent Ng

AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets

Pietro Lesci, Andreas Vlachos

A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models

Tiwalayo Eisape, Michael Tessler, Ishita Dasgupta, Fei Sha, Sjoerd Steenkiste

Efficient End-to-End Visual Document Understanding with Rationale Distillation

Wang Zhu, Alekh Agarwal, Mandar Joshi, Robin Jia, Jesse Thomason

David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs

Xiaochuang Han, Sachin Kumar, Yulia Tsvetkov, Marjan Ghazvininejad

REPLUG: Retrieval-Augmented Black-Box Language Models

Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Richard James

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation

Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, Mohit Bansal, Jason Weston

CNER: Concept and Named Entity Recognition

Giuliano Martinelli, Francesco Molfese, Simone Tedeschi, Alberte Fernández-Castro, Roberto Navigli

Adaptive Cross-lingual Text Classification through In-Context One-Shot Demonstrations

Emilio Cueva, Adrian Lopez Monroy, Fernando Sanchez-Vega, Thamar Solorio

Mustango: Toward Controllable Text-to-Music Generation

Jan Melechovsky, Zixun Guo, Deepanway Ghosal, Navonil Majumder, Dorien Herremans

Rationale-based Opinion Summarization

Haoyuan Li, Snigdha Chaturvedi

FAMuS: Frames Across Multiple Sources

Siddharth Vashishtha, Alexander Martin, William Gantt, Benjamin Van Durme, Aaron Steven White

HumanRankEval: Automatic Evaluation of LMs as Conversational Assistants

Milan Gritta, Gerasimos Lampouras, Ignacio Iacobacci

ARM: Alignment with Residual Energy-Based Model

Bo Pang, Caiming Xiong, Yingbo Zhou

Enhancing Argument Summarization: Prioritizing Exhaustiveness in Key Point Generation and Introducing an Automatic Coverage Evaluation Metric

Mohammad Khosravani, Chenyang Huang, Amine Trabelsi

SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU

Evgeniia Razumovskaia, Goran Glavaš, Anna Korhonen, Ivan Vulić

Depression Detection in Clinical Interviews with LLM-Empowered Structural Element Graph

Zhuang Chen, Jiawen Deng, Jinfeng Zhou, Jincenzi Wu, Tieyun Qian

Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model

Zhiwei He, Xing Wang, Wenxiang Jiao, Zhuosheng Zhang, Rui Wang

AceGPT, Localizing Large Language Models in Arabic

Huang Huang, Fei Yu, Jianqing Zhu, Xuening Sun, Hao Cheng

IterCQR: Iterative Conversational Query Reformulation with Retrieval Guidance

Yunah Jang, Kang-il Lee, Hyunkyung Bae, Hwanhee Lee, Kyomin Jung

Discovering Lobby-Parliamentarian Alignments through NLP

Aswin Suresh, Lazar Radojević, Francesco Salvi, Antoine Magron, Victor Kristof

Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?

Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, Taro Watanabe

MaCSC: Towards Multimodal-augmented Pre-trained Language Models via Conceptual Prototypes and Self-balancing Calibration

Xianwei Zhuang, Zhichang Wang, Xuxin Cheng, Yuxin Xie, Liming Liang

Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment

Chong Li, Shaonan Wang, Jiajun Zhang, Chengqing Zong

BUST: Benchmark for the evaluation of detectors of LLM-Generated Text

Joseph Cornelius, Oscar Lithgow-Serrano, Sandra Mitrović, Ljiljana Dolamic, Fabio Rinaldi

SemRoDe: Macro Adversarial Training to Learn Representations that are Robust to Word-Level Attacks

Brian Formento, Wenjie Feng, Chuan-Sheng Foo, Anh Tuan Luu, See-Kiong Ng

MOSAICo: a Multilingual Open-text Semantically Annotated Interlinked Corpus

Simone Conia, Edoardo Barba, Abelardo Carlos Martínez Lorenzo, Pere-Lluís Huguet Cabot, Riccardo Orlando

Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation

Jie Ruan, Wenqing Wang, Xiaojun Wan

What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?

Yan Zeng, Hanbo Zhang, Jiani Zheng, Jiangnan Xia, Guoqiang Wei

“You are an expert annotator”: Automatic Best–Worst-Scaling Annotations for Emotion Intensity Modeling

Christopher Bagdon, Prathamesh Karmalkar, Harsha Gurulingappa, Roman Klinger

SuperGLEBer: German Language Understanding Evaluation Benchmark

Jan Pfister, Andreas Hotho

HIL: Hybrid Isotropy Learning for Zero-shot Performance in Dense retrieval

Jaeyoung Kim, Dohyeon Lee, Seung-won Hwang

Large Language Models can Contrastively Refine their Generation for Better Sentence Representation Learning

Huiming Wang, Zhaodonghui Li, Liying Cheng, De Wen Soh, Lidong Bing

Explaining Text Similarity in Transformer Models

Alexandros Vasileiou, Oliver Eberle

Actively Learn from LLMs with Uncertainty Propagation for Generalized Category Discovery

Jinggui Liang, Lizi Liao, Hao Fei, Bobo Li, Jing Jiang

Multilingual Nonce Dependency Treebanks: Understanding how Language Models Represent and Process Syntactic Structure

David Arps, Laura Kallmeyer, Younes Samih, Hassan Sajjad

Leitner-Guided Memory Replay for Cross-lingual Continual Learning

Meryem M’hamdi, Jonathan May

Naive Bayes-based Context Extension for Large Language Models

Jianlin Su, Murtadha Ahmed, Bo Wen, Luo Ao, Mingren Zhu

Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output

Haojie Zhuang, Wei Emma Zhang, Leon Xie, Weitong Chen, Jian Yang

Learning to Compress Prompt in Natural Language Formats

Yu-Neng Chuang, Tianwei Xing, Chia-Yuan Chang, Zirui Liu, Xun Chen

A Theory Guided Scaffolding Instruction Framework for LLM-Enabled Metaphor Reasoning

Yuan Tian, Nan Xu, Wenji Mao

SCANNER: Knowledge-Enhanced Approach for Robust Multi-modal Named Entity Recognition of Unseen Entities

Hyunjong Ok, Taeho Kil, Sukmin Seo, Jaeho Lee

Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval

Nandan Thakur, Jianmo Ni, Gustavo Hernandez Abrego, John Wieting, Jimmy Lin

IndiSentiment140: Sentiment Analysis Dataset for Indian Languages with Emphasis on Low-Resource Languages using Machine Translation

Saurabh Kumar, Ranbir Sanasam, Sukumar Nandi

Deceptive Semantic Shortcuts on Reasoning Chains: How Far Can Models Go without Hallucination?

Bangzheng Li, Ben Zhou, Fei Wang, Xingyu Fu, Dan Roth

PELMS: Pre-training for Effective Low-Shot Multi-Document Summarization

Joseph Peper, Wenzhao Qiu, Lu Wang

Safer-Instruct: Aligning Language Models with Automated Preference Data

Taiwei Shi, Kai Chen, Jieyu Zhao

From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning

Ming Li, Yong Zhang, Zhitao Li, Jiuhai Chen, Lichang Chen

Interplay of Machine Translation, Diacritics, and Diacritization

Wei-rui Chen, Ife Adebara, Muhammad Abdul-Mageed

MisgenderMender: A Community-Informed Approach to Interventions for Misgendering

Tamanna Hossain, Sunipa Dev, Sameer Singh

Measuring Cross-lingual Transfer in Bytes

Leandro De Souza, Thales Almeida, Roberto Lotufo, Rodrigo Frassetto Nogueira

UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback

Jason Wu, Eldon Schoop, Alan Leung, Titus Barik, Jeffrey Bigham

LeanReasoner: Boosting Complex Logical Reasoning with Lean

Dongwei Jiang, Marcio Fonseca, Shay Cohen

Can Language Model Moderators Improve the Health of Online Discourse?

Hyundong Cho, Shuai Liu, Taiwei Shi, Darpan Jain, Basem Rizk

How did we get here? Summarizing conversation dynamics

Yilun Hua, Nicholas Chernogor, Yuzhe Gu, Seoyeon Jeong, Miranda Luo

DUQGen: Effective Unsupervised Domain Adaptation of Neural Rankers by Diversifying Synthetic Query Generation

Ramraj Chandradevan, Kaustubh Dhole, Eugene Agichtein

DeMuX: Data-efficient Multilingual Learning

Simran Khanuja, Srinivas Gowriraj, Lucio Dery, Graham Neubig

Analysis of State-Level Legislative Process in Enhanced Linguistic and Nationwide Network Contexts

Maryam Davoodi, Dan Goldwasser

Parameter-Efficient Instruction Tuning of Large Language Models For Extreme Financial Numeral Labelling

Subhendu Khatuya, Rajdeep Mukherjee, Akash Ghosh, Manjunath Hegde, Koustuv Dasgupta

CERET: Cost-Effective Extrinsic Refinement for Text Generation

Jason Cai, Hang Su, Monica Sunkara, Igor Shalyminov, Saab Mansour

Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo

Barkavi Sundararajan, Yaji Sripada, Ehud Reiter

Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks

Negar Mokhberian, Myrl Marmarelis, Frederic Hopp, Valerio Basile, Fred Morstatter

CCSum: A Large-Scale and High-Quality Dataset for Abstractive News Summarization

Xiang Jiang, Markus Dreyer

The steerability of large language models toward data-driven personas

Junyi Li, Charith Peris, Ninareh Mehrabi, Palash Goyal, Kai-Wei Chang

Towards Explainability in Legal Outcome Prediction Models

Josef Valvoda, Ryan Cotterell

Pregnant Questions: The Importance of Pragmatic Awareness in Maternal Health Question Answering

Neha Srikanth, Rupak Sarkar, Heran Mane, Elizabeth Aparicio, Quynh Nguyen

The Impact of Depth on Compositional Generalization in Transformer Language Models

Jackson Petty, Sjoerd Steenkiste, Ishita Dasgupta, Fei Sha, Dan Garrette

Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks

Nadezhda Chirkova, Vassilina Nikoulina

Generalizable Multilingual Hate Speech Detection on Low Resource Indian Languages using Fair Selection in Federated Learning

Akshay Singh, Rahul Thakur

Towards Reducing Diagnostic Errors with Interpretable Risk Prediction

Denis McInerney, William Dickinson, Lucy Flynn, Andrea Young, Geoffrey Young

F-MALLOC: Feed-forward Memory Allocation for Continual Learning in Neural Machine Translation

Junhong Wu, Yuchen Liu, Chengqing Zong

Extremely Weakly-supervised Text Classification with Wordsets Mining and Sync-Denoising

Lysa Xiao

KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation

Xindi Luo, Zequn Sun, Jing Zhao, Zhe Zhao, Wei Hu

Bridging the Gap between Different Vocabularies for LLM Ensemble

Yangyifan Xu, Jinliang Lu, Jiajun Zhang

R-Tuning: Instructing Large Language Models to Say ‘I Don’t Know’

Hanning Zhang, SHIZHE DIAO, Yong Lin, Yi Fung, Qing LIAN

Elastic Weight Removal for Faithful and Abstractive Dialogue Generation

Nico Daheim, Nouha Dziri, Mrinmaya Sachan, Iryna Gurevych, Edoardo Ponti

Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling

Yupu Liang, Yaping Zhang, Cong Ma, Zhiyang Zhang, Yang Zhao

Are Large Language Model Temporally Grounded?

Yifu Qiu, Zheng Zhao, Yftah Ziser, Anna Korhonen, Edoardo Ponti

Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Method

Yukun Zhao, Lingyong Yan, Weiwei Sun, Guoliang Xing, Chong Meng

Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity

Soyeong Jeong, Jinheon Baek, Sukmin Cho, Sung Ju Hwang, Jong Park

UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing

Yijun Yang, Jie He, Pinzhen Chen, Victor Gutierrez Basulto, Jeff Pan

Leveraging the Structure of Pre-trained Embeddings to Minimize Annotation Effort

Cesar Gonzalez-Gutierrez, Ariadna Quattoni

On the Effectiveness of Adversarial Robustness for Abuse Mitigation with Counterspeech

Yi-Ling Chung, Jonathan Bright

NLP Progress in Indigenous Latin American Languages

Atnafu Tonja, Fazlourrahman Balouchzahi, Sabur Butt, Olga Kolesnikova, Hector Ceballos

On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons

Takeshi Kojima, Itsuki Okimura, Yusuke Iwasawa, Hitomi Yanaka, Yutaka Matsuo

Reliability Estimation of News Media Sources: Birds of a Feather Flock Together

Sergio Burdisso, Dairazalia Sanchez-cortes, Esau Villatoro-tello, Petr Motlicek