Felix Dangel
12 papers · 2020–2025 · 4 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+4 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (12) π Academic Marathon (5) π Cross-Pollinator (7) π Interdisciplinary Bridge π§ Keyword Pioneer
π
Conference Polyglot
(4)
β‘
Prolific Year
(5)
β
The Questioner
(3)
π
Century Club
(12)
Conferences
ICML (5)
NIPS (4)
ICLR (2)
AISTATS (1)
Top co-authors
Keywords
neural network optimization
(3)
curvature approximation
(2)
model interpretability
(1)
natural gradient
(1)
hessian approximation
(1)
riemannian geometry
(1)
second-order optimization
(1)
convolutional neural network
(1)
physics-informed neural network
(1)
gauss-newton method
(1)
approximate curvature
(1)
parameter space
(1)
tensor network
(1)
neural network
(1)
gradient distribution
(1)
kronecker factorization
(1)
block-diagonal approximation
(1)
generalized gauss-newton
(1)
flatness measure
(1)
block-diagonal curvature
(1)
Papers
Hide & Seek: Transformer Symmetries Obscure Sharpness & Riemannian Geometry Finds It
ICML 2025
What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis
ICLR 2025
Fishers for Free? Approximating the Fisher Information Matrix by Recycling the Squared Gradient Accumulator
ICML 2025
Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks
NIPS 2024
Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning
ICML 2024
Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective
ICML 2024
Structured Inverse-Free Natural Gradient Descent: Memory-Efficient & Numerically-Stable KFAC
ICML 2024
Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods
NIPS 2024
The Geometry of Neural Nets' Parameter Spaces Under Reparametrization
NIPS 2023
Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks
NIPS 2021
Modular Block-diagonal Curvature Approximations for Feedforward Architectures
AISTATS 2020
BackPACK: Packing more into Backprop
ICLR 2020