conftrace_

loss landscape

149 papers

Explore in graph

Co-occurring keywords

neural network optimization (1293) gradient descent (1144) neural network (6616) sharpness-aware minimization (81) stochastic gradient descent (1091) flat minima (50) deep neural network (1803) mode connectivity (17) transfer learning (5449) neural network training (309)

Papers

Sharpness-Aware Training for Free NIPS 2022
Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules NIPS 2022
Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Robustness ICML 2022
What Can Linear Interpolation of Neural Network Loss Landscapes Tell Us? ICML 2022
PoF: Post-Training of Feature Extractor for Improving Generalization ICML 2022
Chaotic Dynamics are Intrinsic to Neural Network Training with SGD NIPS 2022
Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks NIPS 2022
Annihilation of Spurious Minima in Two-Layer ReLU Networks NIPS 2022
A Solver + Gradient Descent Training Algorithm for Deep Neural Networks IJCAI 2022
A Reparametrization-Invariant Sharpness Measure Based on Information Geometry NIPS 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time ICML 2022
Understanding Gradient Descent on the Edge of Stability in Deep Learning ICML 2022
When Do Flat Minima Optimizers Work? NIPS 2022
Deep Reinforcement Learning Policies Learn Shared Adversarial Features across MDPs AAAI 2022
Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry ICML 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NIPS 2022
Exploring Mode Connectivity for Pre-trained Language Models EMNLP 2022
On the Variance of the Fisher Information for Deep Learning NIPS 2021
Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling ICML 2021
Learn2Hop: Learned Optimization on Rough Landscapes ICML 2021
On Monotonic Linear Interpolation of Neural Network Parameters ICML 2021
Characterizing the Loss Landscape in Non-Negative Matrix Factorization AAAI 2021
Relating Adversarially Robust Generalization to Flat Minima ICCV 2021
Tilting the playing field: Dynamical loss functions for machine learning ICML 2021
Exponentially Many Local Minima in Quantum Neural Networks ICML 2021