Samuel S Schoenholz
5 papers · 2021–2022 · 1 conference · across top CS/AI conferences
Achievements
Jump to papers ↓
π
Interdisciplinary Bridge
π§
Keyword Pioneer
π
Cross-Pollinator
(5)
πΊοΈ
Taxonomy Completionist
(14)
π
Keyword Champion
(2)
Conferences
ICML (5)
Top co-authors
Keywords
loss landscape
(2)
neural tangent kernel
(2)
non-convex optimization
(1)
neural network optimization
(1)
symmetric matrix
(1)
information loss
(1)
matrix computation
(1)
hessian eigenvalue
(1)
learned optimization
(1)
training stability
(1)
cross-entropy loss
(1)
local minima
(1)
hessian analysis
(1)
network initialization
(1)
architecture search
(1)
second order optimization
(1)
orthogonal matrix
(1)
finite width
(1)
dynamical loss function
(1)
bifurcation cascade
(1)
Papers
Deep equilibrium networks are sensitive to initialization statistics
ICML 2022
Fast Finite Width Neural Tangent Kernel
ICML 2022
Learn2Hop: Learned Optimization on Rough Landscapes
ICML 2021
Tilting the playing field: Dynamical loss functions for machine learning
ICML 2021
Whitening and Second Order Optimization Both Make Information in the Dataset Unusable During Training, and Can Reduce or Prevent Generalization
ICML 2021