Ethan Dyer
9 papers · 2020–2022 · 3 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (24) 🐣 Hot Topic Early Bird 🧭 Keyword Pioneer
❓
The Questioner
Venues
Top co-authors
Research topics
Deep Learning
(7)
Machine Learning
(7)
Natural Language Processing
(3)
Learning Types · Machine Learning
(3)
Optimization & Theory · Machine Learning
(3)
Artificial Intelligence
(2)
Architectures
(2)
Core AI
(2)
Learning Types · Deep Learning
(2)
Optimization & Theory · Deep Learning
(2)
Techniques
(2)
Knowledge & Reasoning
(1)
Mathematics & Optimization
(1)
Application Areas
(1)
Applications
(1)
Keywords
representation learning
(2)
catastrophic forgetting
(2)
neural network
(2)
continual learning
(2)
stochastic gradient descent
(1)
neural network training
(1)
sequence modeling
(1)
pre-trained model
(1)
mathematical reasoning
(1)
data augmentation
(1)
in-context learning
(1)
language modeling
(1)
out-of-distribution generalization
(1)
distribution shift
(1)
recurrent neural network
(1)
information loss
(1)
second-order optimization
(1)
language model
(1)
curriculum learning
(1)
domain adaptation
(1)
Papers
Block-Recurrent Transformers
NeurIPS 2022
Effect of scale on catastrophic forgetting in neural networks
ICLR 2022
Exploring Length Generalization in Large Language Models
NeurIPS 2022
Solving Quantitative Reasoning Problems with Language Models
NeurIPS 2022
Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics
ICLR 2021
Tradeoffs in Data Augmentation: An Empirical Study
ICLR 2021
When Do Curricula Work?
ICLR 2021
Whitening and Second Order Optimization Both Make Information in the Dataset Unusable During Training, and Can Reduce or Prevent Generalization
ICML 2021
Asymptotics of Wide Networks from Feynman Diagrams
ICLR 2020