William Fedus
13 papers · 2018–2024 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (34) π Conference Polyglot Β· Silver π Academic Marathon Β· Sprint π Interdisciplinary Bridge Β· Silver π£ Hot Topic Early Bird
π
Grand Slam
π§¬
Topic Evolution
π₯
Mega-Team Β· Squad
π
Conference Pioneer
π₯
Unstoppable Β· Bronze
β
The Questioner
π
Century Club Β· Bronze
π
Trend Setter
ποΈ
Keyword Collector
(55)
Top co-authors
Research topics
Machine Learning
(9)
Deep Learning
(8)
Learning Types Β· Machine Learning
(5)
Reinforcement Learning
(4)
Architectures
(4)
Methods
(4)
Artificial Intelligence
(3)
Core AI
(3)
Learning Types Β· Deep Learning
(3)
Optimization & Theory Β· Machine Learning
(3)
Natural Language Processing
(2)
Applications
(2)
Core Methods
(2)
Generation
(2)
Optimization & Theory Β· Deep Learning
(2)
Keywords
model scaling
(3)
deep reinforcement learning
(3)
parameter efficiency
(3)
sample efficiency
(2)
mixture of expert
(2)
language model
(2)
scaling law
(2)
sparse reward
(2)
generative adversarial network
(2)
transfer learning
(2)
text generation
(1)
natural language generation
(1)
computer vision
(1)
model architecture
(1)
reinforcement learning
(1)
transformer architecture
(1)
partial observability
(1)
variational inference
(1)
image classification
(1)
maximum likelihood estimation
(1)
Papers
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
ICLR 2024
Scaling Instruction-Finetuned Language Models
JMLR 2024
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
EMNLP 2023
Scale Efficiently: Insights from Pretraining and Finetuning Transformers
ICLR 2022
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
JMLR 2022
Revisiting ResNets: Improved Training and Scaling Strategies
NeurIPS 2021
Algorithmic Improvements for Deep Reinforcement Learning Applied to Interactive Fiction
AAAI 2020
Language GANs Falling Short
ICLR 2020
On Bonus Based Exploration Methods In The Arcade Learning Environment
ICLR 2020
Revisiting Fundamentals of Experience Replay
ICML 2020
Deep Graph Infomax
ICLR 2019
Recall Traces: Backtracking Models for Efficient Reinforcement Learning
ICLR 2019
MaskGAN: Better Text Generation via Filling in the _______
ICLR 2018