Sam Shleifer

4 papers · 2020–2022 · 2 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (11) 🐣 Hot Topic Early Bird 👥 Mega-Team · Squad

Venues

EMNLP (3) ICLR (1)

Top co-authors

Luke Zettlemoyer (3) Naman Goyal (2) Jingfei Du (2) Ramakanth Pasunuru (2) Mikel Artetxe (2) Xi Victoria Lin (2) Myle Ott (2) Todor Mihaylov (2) Shuohui Chen (2) Veselin Stoyanov (2)

Research topics

Deep Learning (3) Natural Language Processing (2) Resources & Methods (2) Artificial Intelligence (1) Machine Learning (1) Architectures (1) Learning Paradigms (1) Learning Types · Deep Learning (1) Learning Types · Machine Learning (1) Models (1) Optimization & Theory (1) Techniques (1)

Keywords

transformer architecture (1) zero-shot learning (1) few-shot learning (1) natural language processing (1) machine translation (1) natural language inference (1) cross-lingual transfer (1) language modeling (1) model pretraining (1) language model (1) pre-trained model (1) model fine-tuning (1) memory footprint (1) multilingual language model (1) dynamic quantization (1) block-wise quantization (1) optimizer state (1) gradient statistics (1)

Papers

8-bit Optimizers via Block-wise Quantization ICLR 2022 Efficient Large Scale Language Modeling with Mixtures of Experts EMNLP 2022 Few-shot Learning with Multilingual Generative Language Models EMNLP 2022 Transformers: State-of-the-Art Natural Language Processing EMNLP 2020