William Fedus
13 papers · 2018–2024 · 6 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+10 more ↓ Show less ↑
🐝 Cross-Pollinator (11) 🧭 Keyword Pioneer 🌍 Conference Polyglot (6) 🏃 Academic Marathon (6) 🌈 Renaissance Researcher (6)
🐣
Hot Topic Early Bird
🌍
Conference Polyglot
(6)
🏃
Academic Marathon
(6)
🏆
Grand Slam
👥
Mega-Team
(35)
🔥
Unstoppable
(7)
🚀
Conference Pioneer
💎
Century Club
(13)
❓
The Questioner
📈
Trend Setter
Conferences
ICLR (7)
JMLR (2)
AAAI (1)
EMNLP (1)
ICML (1)
NIPS (1)
Top co-authors
Research topics
Keywords
model scaling
(3)
deep reinforcement learning
(2)
transfer learning
(2)
language model
(2)
interactive fiction
(1)
computer vision
(1)
model architecture
(1)
partial observability
(1)
inductive bia
(1)
contextualisation mechanism
(1)
scaling law
(1)
mixture of expert
(1)
sparse activation
(1)
sparse reward
(1)
image classification
(1)
parameter efficiency
(1)
action space
(1)
experience replay
(1)
text-based game
(1)
off-policy algorithm
(1)
Papers
Scaling Instruction-Finetuned Language Models
JMLR 2024
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
ICLR 2024
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
EMNLP 2023
Scale Efficiently: Insights from Pretraining and Finetuning Transformers
ICLR 2022
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
JMLR 2022
Revisiting ResNets: Improved Training and Scaling Strategies
NIPS 2021
Revisiting Fundamentals of Experience Replay
ICML 2020
Algorithmic Improvements for Deep Reinforcement Learning Applied to Interactive Fiction
AAAI 2020
Language GANs Falling Short
ICLR 2020
On Bonus Based Exploration Methods In The Arcade Learning Environment
ICLR 2020
Recall Traces: Backtracking Models for Efficient Reinforcement Learning
ICLR 2019
Deep Graph Infomax
ICLR 2019
MaskGAN: Better Text Generation via Filling in the _______
ICLR 2018