Jack Rae
15 papers · 2016–2022 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+11 more ↓ Show less ↑
🌍 Conference Polyglot (5) 🐣 Hot Topic Early Bird 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🏃 Academic Marathon (6)
🐣
Hot Topic Early Bird
🐝
Cross-Pollinator
(14)
🌍
Conference Polyglot
(5)
🌟
Keyword Trendsetter Combo
(3)
👥
Mega-Team
(28)
👑
Triple Crown
⚡
Prolific Year
(6)
🗃️
Keyword Collector
(69)
❓
The Questioner
📈
Trend Setter
💎
Century Club
(15)
Conferences
NIPS (6)
ICML (5)
ICLR (2)
ACL (1)
EMNLP (1)
Top co-authors
Keywords
language modeling
(3)
language model
(3)
sequence modeling
(2)
reinforcement learning
(2)
scaling law
(2)
transformer architecture
(2)
one-shot learning
(2)
question answering
(1)
attention mechanism
(1)
image classification
(1)
policy gradient
(1)
natural language generation
(1)
computational efficiency
(1)
text generation
(1)
sentiment analysis
(1)
document retrieval
(1)
adversarial training
(1)
few-shot learning
(1)
bias detection
(1)
multi-task learning
(1)
Papers
An empirical analysis of compute-optimal large language model training
NIPS 2022
Unified Scaling Laws for Routed Language Models
ICML 2022
Improving Language Models by Retrieving from Trillions of Tokens
ICML 2022
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
EMNLP 2020
Top-KAST: Top-K Always Sparse Training
NIPS 2020
Do Transformers Need Deep Long-Range Memory?
ACL 2020
Meta-Learning Deep Energy-Based Memory Models
ICLR 2020
Multiplicative Interactions and Where to Find Them
ICLR 2020
Stabilizing Transformers for Reinforcement Learning
ICML 2020
Training Language GANs from Scratch
NIPS 2019
Meta-Learning Neural Bloom Filters
ICML 2019
Relational recurrent neural networks
NIPS 2018
Fast Parametric Learning with Activation Memorization
ICML 2018
Neural Arithmetic Logic Units
NIPS 2018
Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes
NIPS 2016