conftrace_

flatness regularization

4 papers

Explore in graph

Co-occurring keywords

learning to optimize (15) optimizer generalization (1) deep matrix factorization (6) parameter perturbation (10) schatten norm (15) large language model (13587) hessian trace (5) flatness-aware regularization (1) gradient projection memory (1) weight loss landscape (1)

Papers

Learning to Generalize Provably in Learning to Optimize AISTATS 2023
Flatness-Aware Prompt Selection Improves Accuracy and Sample Efficiency EMNLP 2023
What is the Inductive Bias of Flatness Regularization? A Study of Deep Matrix Factorization Models NIPS 2023
Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learning NIPS 2021