Etai Littwin
17 papers · 2015–2025 · 5 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (32) π Academic Marathon Β· Half π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Silver π£ Hot Topic Early Bird
π
Triple Crown
β‘
Prolific Year Β· Productive
π
Century Club Β· Bronze
β
The Questioner
(2)
ποΈ
Keyword Collector
(76)
π₯
Unstoppable Β· Bronze
Venues
Top co-authors
Research topics
Machine Learning
(14)
Deep Learning
(11)
Optimization & Theory Β· Machine Learning
(10)
Architectures
(8)
Optimization & Theory Β· Deep Learning
(6)
Core Methods
(5)
Artificial Intelligence
(4)
Core AI
(4)
Learning Types Β· Machine Learning
(3)
Application Areas
(2)
Learning Types Β· Deep Learning
(2)
Techniques
(2)
Computer Science
(1)
Computer Vision
(1)
Mathematics & Optimization
(1)
Keywords
neural network
(5)
neural tangent kernel
(5)
neural network optimization
(3)
representation learning
(2)
feature learning
(2)
infinite-width limit
(2)
self-supervised learning
(2)
neural network training
(1)
in-context learning
(1)
3d reconstruction
(1)
fisher kernel
(1)
outlier detection
(1)
batch normalization
(1)
policy gradient
(1)
relational reasoning
(1)
ensemble learning
(1)
function space
(1)
low-rank approximation
(1)
out-of-distribution generalization
(1)
transfer learning
(1)
Papers
Distillation Scaling Laws
ICML 2025
How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networks
NeurIPS 2024
LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures
ICLR 2024
Vanishing Gradients in Reinforcement Finetuning of Language Models
ICLR 2024
What Algorithms can Transformers Learn? A Study in Length Generalization
ICLR 2024
When can transformers reason with abstract symbols?
ICLR 2024
Adaptive Optimization in the β-Width Limit
ICLR 2023
Stabilizing Transformer Training by Preventing Attention Entropy Collapse
ICML 2023
Transformers learn through gradual rank increase
NeurIPS 2023
Learning Representation from Neural Fisher Kernel with Low-rank Approximation
ICLR 2022
On random kernels of residual architectures
UAI 2021
Tensor Programs IIb: Architectural Universality Of Neural Tangent Kernel Training Dynamics
ICML 2021
Collegial Ensembles
NeurIPS 2020
On Infinite-Width Hypernetworks
NeurIPS 2020
Regularizing by the Variance of the Activations' Sample-Variances
NeurIPS 2018
The Multiverse Loss for Robust Transfer Learning
CVPR 2016
Spherical Embedding of Inlier Silhouette Dissimilarities
CVPR 2015