conftrace_

loss surface

22 papers

Explore in graph

Co-occurring keywords

local minimum (61) neural network (6616) stochastic gradient descent (1091) saddle point (95) neural network optimization (1293) spin-glass model (3) critical point (24) mode connectivity (17) deep neural network (1803) random matrix theory (63)

Papers

Second-order forward-mode optimization of recurrent neural networks for neuroscience NIPS 2024
Data Augmented Flatness-aware Gradient Projection for Continual Learning ICCV 2023
GeNAS: Neural Architecture Search with Better Generalization IJCAI 2023
Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors NIPS 2022
Non-attracting Regions of Local Minima in Deep and Wide Neural Networks JMLR 2021
Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling ICML 2021
ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks ICML 2021
Deep Learning on a Data Diet: Finding Important Examples Early in Training NIPS 2021
Low-loss connection of weight vectors: distribution-based approaches ICML 2020
Ridge Rider: Finding Diverse Solutions by Following Eigenvectors of the Hessian NIPS 2020
HLHLp: Quantized Neural Networks Training for Reaching Flat Minima in Loss Surface AAAI 2020
Deep Neural Networks with Multi-Branch Architectures Are Intrinsically Less Non-Convex AISTATS 2019
Robustness via Curvature Regularization, and Vice Versa CVPR 2019
Piecewise Strong Convexity of Neural Networks NIPS 2019
Understanding the Loss Surface of Neural Networks for Binary Classification ICML 2018
The Multilinear Structure of ReLU Networks ICML 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs NIPS 2018
An Alternative View: When Does SGD Escape Local Minima? ICML 2018
Geometry of Neural Network Loss Surfaces via Random Matrix Theory ICML 2017
The Loss Surface of Deep and Wide Neural Networks ICML 2017
Open Problem: The landscape of the loss surfaces of multilayer networks COLT 2015
The Loss Surfaces of Multilayer Networks AISTATS 2015