Aitor Lewkowycz
6 papers · 2020–2023 · 3 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Silver 🗺️ Taxonomy Completionist (22) 🐣 Hot Topic Early Bird 👥 Mega-Team · Legion
🧭
Keyword Pioneer
Venues
Top co-authors
Research topics
Deep Learning
(4)
Machine Learning
(4)
Natural Language Processing
(4)
Artificial Intelligence
(3)
Learning Types · Machine Learning
(3)
Core AI
(2)
Learning Paradigms
(2)
Learning Types · Deep Learning
(2)
Optimization & Theory
(2)
Resources & Methods
(2)
Computer Science
(1)
Knowledge & Reasoning
(1)
Application Areas
(1)
Applications · Computer Science
(1)
Applications · Natural Language Processing
(1)
Keywords
large language model
(3)
neural network
(2)
catastrophic forgetting
(1)
few-shot learning
(1)
mathematical reasoning
(1)
in-context learning
(1)
deep learning theory
(1)
neural network optimization
(1)
out-of-distribution generalization
(1)
distributed computing
(1)
l2 regularization
(1)
gradient flow
(1)
language model
(1)
pre-trained model
(1)
training dynamics
(1)
model scaling
(1)
pre-trained language model
(1)
length generalization
(1)
data pipeline
(1)
quantitative reasoning
(1)
Papers
PaLM: Scaling Language Modeling with Pathways
JMLR 2023
Scaling Up Models and Data with t5x and seqio
JMLR 2023
Effect of scale on catastrophic forgetting in neural networks
ICLR 2022
Exploring Length Generalization in Large Language Models
NeurIPS 2022
Solving Quantitative Reasoning Problems with Language Models
NeurIPS 2022
On the training dynamics of deep networks with L_2 regularization
NeurIPS 2020