Jack Rae
15 papers · 2016–2022 · 5 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (34) π Academic Marathon Β· Sprint π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Bronze π£ Hot Topic Early Bird
π
Keyword Trendsetter Combo
(3)
π₯
Mega-Team Β· Squad
π
Triple Crown
π§
Keyword Pioneer
π
Trend Setter
β‘
Prolific Year Β· Productive
β
The Questioner
ποΈ
Keyword Collector
(80)
π
Century Club Β· Bronze
Venues
Top co-authors
Research topics
Deep Learning
(10)
Artificial Intelligence
(9)
Machine Learning
(9)
Architectures
(6)
Core AI
(6)
Application Areas
(5)
Natural Language Processing
(4)
Core Methods
(4)
Learning Types
(4)
Optimization & Theory Β· Machine Learning
(4)
Learning Paradigms
(3)
Models
(3)
Generation
(2)
Optimization & Theory Β· Deep Learning
(2)
Resources & Methods
(2)
Keywords
language modeling
(3)
language model
(3)
sequence modeling
(2)
one-shot learning
(2)
transformer architecture
(2)
attention mechanism
(2)
reinforcement learning
(2)
scaling law
(2)
natural language generation
(1)
policy gradient
(1)
image classification
(1)
sentiment analysis
(1)
few-shot learning
(1)
question answering
(1)
neural network pruning
(1)
adversarial training
(1)
bias detection
(1)
text generation
(1)
document retrieval
(1)
multi-task learning
(1)
Papers
An empirical analysis of compute-optimal large language model training
NeurIPS 2022
Improving Language Models by Retrieving from Trillions of Tokens
ICML 2022
Unified Scaling Laws for Routed Language Models
ICML 2022
Do Transformers Need Deep Long-Range Memory?
ACL 2020
Meta-Learning Deep Energy-Based Memory Models
ICLR 2020
Multiplicative Interactions and Where to Find Them
ICLR 2020
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
EMNLP 2020
Stabilizing Transformers for Reinforcement Learning
ICML 2020
Top-KAST: Top-K Always Sparse Training
NeurIPS 2020
Meta-Learning Neural Bloom Filters
ICML 2019
Training Language GANs from Scratch
NeurIPS 2019
Fast Parametric Learning with Activation Memorization
ICML 2018
Neural Arithmetic Logic Units
NeurIPS 2018
Relational recurrent neural networks
NeurIPS 2018
Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes
NeurIPS 2016