Large Language Models

What Do Transformers Know about Government? COLING 2024 What Drives Performance in Multilingual Language Models? NAACL 2024 What Factors Affect Multi-Modal In-Context Learning? An In-Depth Exploration NeurIPS 2024 What Factors Influence LLMs’ Judgments? A Case Study on Question Answering COLING 2024 What GPT-4 Knows about Aspectual Coercion: Focused on “Begin the Book” COLING 2024 What is the Best Way for ChatGPT to Translate Poetry? ACL 2024 “What is the value of templates?” Rethinking Document Information Extraction Datasets for LLMs EMNLP 2024 What Kind of Sourcery is This? Evaluating GPT-4’s Performance on Linking Scientific Fact to Citations EMNLP 2024 What Makes a Good Order of Examples in In-Context Learning ACL 2024 What Makes and Breaks Safety Fine-tuning? A Mechanistic Study NeurIPS 2024 What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning ICLR 2024 What Makes Math Word Problems Challenging for LLMs? NAACL 2024 What Matters in Memorizing and Recalling Facts? Multifaceted Benchmarks for Knowledge Probing in Language Models EMNLP 2024 What Matters in Training a GPT4-Style Language Model with Multimodal Inputs? NAACL 2024 What matters when building vision-language models? NeurIPS 2024 What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation ICML 2024 What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement ICML 2024 When ”A Helpful Assistant” Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models EMNLP 2024 When Context Leads but Parametric Memory Follows in Large Language Models EMNLP 2024 When Do LLMs Need Retrieval Augmentation? Mitigating LLMs’ Overconfidence Helps Retrieval Augmentation ACL 2024 When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models NAACL 2024 When LLMs Meet Cunning Texts: A Fallacy Understanding Benchmark for Large Language Models NeurIPS 2024 When Parts Are Greater Than Sums: Individual LLM Components Can Outperform Full Models EMNLP 2024 When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method ICLR 2024 Where am I? Large Language Models Wandering between Semantics and Structures in Long Contexts EMNLP 2024