conftrace_

hessian spectrum

11 papers

Explore in graph

Co-occurring keywords · papers mentioning both

stochastic gradient descent (3) spurious minima (2) relu neural network (2) gradient descent (2) loss landscape (2) neural network optimization (2) bifurcation theory (1) two-layer relu neural network (1) equivariant bifurcation theory (1) block heterogeneity (1)

Papers

Suspicious Alignment of SGD:A Fine-Grained Step Size Condition Analysis ALT 2026 Efficient Sketches for Training Data Attribution and Studying the Loss Landscape NeurIPS 2024 Why Transformers Need Adam: A Hessian Perspective NeurIPS 2024 Annihilation of Spurious Minima in Two-Layer ReLU Networks NeurIPS 2022 Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objectives with Skewed Hessian Spectrums ICLR 2022 Phenomenology of Double Descent in Finite-Width Neural Networks ICLR 2022 Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II NeurIPS 2021 The asymptotic spectrum of the Hessian of DNN throughout training ICLR 2020 HAWQ: Hessian AWare Quantization of Neural Networks With Mixed-Precision ICCV 2019 Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians ICML 2019 Hessian-based Analysis of Large Batch Training and Robustness to Adversaries NeurIPS 2018