flat minima

Towards Understanding Sharpness-Aware Minimization ICML 2022 When Do Flat Minima Optimizers Work? NeurIPS 2022 A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima ICLR 2021 Entropic gradient descent algorithms and wide flat minima ICLR 2021 Implicit Gradient Regularization ICLR 2021 Noisy Gradient Descent Converges to Flat Minima for Nonconvex Matrix Factorization AISTATS 2021 On Linear Stability of SGD and Input-Smoothness of Neural Networks NeurIPS 2021 Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minima NeurIPS 2021 Regularising Fisher Information Improves Cross-lingual Generalisation EMNLP 2021 Regularizing Neural Networks via Adversarial Model Perturbation CVPR 2021 Relating Adversarially Robust Generalization to Flat Minima ICCV 2021 SWAD: Domain Generalization by Seeking Flat Minima NeurIPS 2021 HLHLp: Quantized Neural Networks Training for Reaching Flat Minima in Loss Surface AAAI 2020 Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks Using PAC-Bayesian Analysis ICML 2020 Towards Theoretically Understanding Why Sgd Generalizes Better Than Adam in Deep Learning NeurIPS 2020 Unique Properties of Flat Minima in Deep Networks ICML 2020 Sharp Minima Can Generalize For Deep Nets ICML 2017