Mike Lewis

Byte Latent Transformer: Patches Scale Better Than Tokens ACL 2025 Law of the Weakest Link: Cross Capabilities of Large Language Models ICLR 2025 BTS: Harmonizing Specialized Experts into a Generalist LLM EMNLP 2025 Compute Optimal Scaling of Skills: Knowledge vs Reasoning ACL 2025 Effective Long-Context Scaling of Foundation Models NAACL 2024 In-Context Pretraining: Language Modeling Beyond Document Boundaries ICLR 2024 RA-DIT: Retrieval-Augmented Dual Instruction Tuning ICLR 2024 Efficient Streaming Language Models with Attention Sinks ICLR 2024 Self-Alignment with Instruction Backtranslation ICLR 2024 Trusting Your Evidence: Hallucinate Less with Context-aware Decoding NAACL 2024 REPLUG: Retrieval-Augmented Black-Box Language Models NAACL 2024 Progressive Prompts: Continual Learning for Language Models ICLR 2023 LIMA: Less Is More for Alignment NIPS 2023 Measuring and Narrowing the Compositionality Gap in Language Models EMNLP 2023 AutoReply: Detecting Nonsense in Dialogue with Discriminative Replies EMNLP 2023 FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation EMNLP 2023 InCoder: A Generative Model for Code Infilling and Synthesis ICLR 2023 Contrastive Decoding: Open-ended Text Generation as Optimization ACL 2023 Nonparametric Masked Language Modeling ACL 2023 Residual Prompt Tuning: improving prompt tuning with residual reparameterization ACL 2023 Retrieval-Augmented Multimodal Language Modeling ICML 2023 In-context Examples Selection for Machine Translation ACL 2023 Coder Reviewer Reranking for Code Generation ICML 2023 MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers NIPS 2023 Question Answering Infused Pre-training of General-Purpose Contextualized Representations ACL 2022 HTLM: Hyper-Text Pre-Training and Prompting of Language Models ICLR 2022 Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation ICLR 2022 8-bit Optimizers via Block-wise Quantization ICLR 2022 DEMix Layers: Disentangling Domains for Modular Language Modeling NAACL 2022 Tricks for Training Sparse Translation Models NAACL 2022 GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale NIPS 2022 Noisy Channel Language Model Prompting for Few-Shot Text Classification ACL 2022 MetaICL: Learning to Learn In Context NAACL 2022 Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022 Improving Passage Retrieval with Zero-Shot Question Generation EMNLP 2022 Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? EMNLP 2022 Joint Verification and Reranking for Open Fact Checking Over Tables IJCNLP 2021 Shortformer: Better Language Modeling using Shorter Inputs ACL 2021 Nearest Neighbor Machine Translation ICLR 2021 Multitasking Inhibits Semantic Drift NAACL 2021 Joint Verification and Reranking for Open Fact Checking Over Tables ACL 2021 BASE Layers: Simplifying Training of Large, Sparse Models ICML 2021 Shortformer: Better Language Modeling using Shorter Inputs IJCNLP 2021 Grounded Adaptation for Zero-shot Executable Semantic Parsing EMNLP 2020 Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks NIPS 2020 Pre-training via Paraphrasing NIPS 2020 Asking and Answering Questions to Evaluate the Factual Consistency of Summaries ACL 2020 BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension ACL 2020 Conversational Semantic Parsing EMNLP 2020 Generalization through Memorization: Nearest Neighbor Language Models ICLR 2020 Hierarchical Decision Making by Generating and Following Natural Language Instructions NIPS 2019 Span-based Hierarchical Semantic Parsing for Task-Oriented Dialog EMNLP 2019 Generative Question Answering: Learning to Answer the Whole Question ICLR 2019 Span-based Hierarchical Semantic Parsing for Task-Oriented Dialog IJCNLP 2019 Proceedings of the First Workshop on NLP for Conversational AI ACL 2019 Strategies for Structuring Story Generation ACL 2019 Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog NAACL 2019 Hierarchical Neural Story Generation ACL 2018 Semantic Parsing for Task Oriented Dialog using Hierarchical Representations EMNLP 2018 Neural Compositional Denotational Semantics for Question Answering EMNLP 2018 A Dataset for Telling the Stories of Social Media Videos EMNLP 2018 Hierarchical Text Generation and Planning for Strategic Dialogue ICML 2018 Deep Semantic Role Labeling: What Works and What’s Next ACL 2017 Deal or No Deal? End-to-End Learning of Negotiation Dialogues EMNLP 2017 End-to-end Neural Coreference Resolution EMNLP 2017 A Corpus of Natural Language for Visual Reasoning ACL 2017 Human-in-the-Loop Parsing EMNLP 2016 Global Neural CCG Parsing with Optimality Guarantees EMNLP 2016 LSTM CCG Parsing NAACL 2016 Joint A* CCG Parsing and Semantic Role Labelling EMNLP 2015 Question-Answer Driven Semantic Role Labeling: Using Natural Language to Annotate Natural Language EMNLP 2015 A* CCG Parsing with a Supertag-factored Model EMNLP 2014 Unsupervised Induction of Cross-Lingual Semantic Relations EMNLP 2013