conftrace_

sharpness-aware minimization

81 papers

Explore in graph

Also known as

SAM

Co-occurring keywords

neural network optimization (1293) loss landscape (149) flat minima (50) model generalization (190) gradient descent (1144) stochastic gradient descent (1091) neural network (6616) generalization bound (652) adversarial perturbation (384) flat minimum (15)

Papers

The Crucial Role of Normalization in Sharpness-Aware Minimization NIPS 2023
Normalization Layers Are All That Sharpness-Aware Minimization Needs NIPS 2023
Decentralized SGD and Average-direction SAM are Asymptotically Equivalent ICML 2023
Why Does Sharpness-Aware Minimization Generalize Better Than SGD? NIPS 2023
An SDE for Modeling SAM: Theory and Insights ICML 2023
Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization CVPR 2023
Sharpness-Aware Gradient Matching for Domain Generalization CVPR 2023
ImbSAM: A Closer Look at Sharpness-Aware Minimization in Class-Imbalanced Recognition ICCV 2023
Enhancing Sharpness-Aware Optimization Through Variance Suppression NIPS 2023
Riemannian SAM: Sharpness-Aware Minimization on Riemannian Manifolds NIPS 2023
Class-Conditional Sharpness-Aware Minimization for Deep Long-Tailed Recognition CVPR 2023
Fairness-aware class imbalanced learning on multiple subgroups UAI 2023
Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimization ICCV 2023
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NIPS 2022
GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization EMNLP 2022
Sharpness-Aware Minimization Improves Language Model Generalization ACL 2022
Sharpness-Aware Training for Free NIPS 2022
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models EMNLP 2022
Sharpness-Aware Minimization with Dynamic Reweighting EMNLP 2022
When Do Flat Minima Optimizers Work? NIPS 2022
Towards Efficient and Scalable Sharpness-Aware Minimization CVPR 2022
Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models EMNLP 2022
Random Sharpness-Aware Minimization NIPS 2022
Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data NIPS 2022
Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning ICML 2022