gradient descent

Exponentially Many Local Minima in Quantum Neural Networks ICML 2021 Extreme Memorization via Scale of Initialization ICLR 2021 Faster Directional Convergence of Linear Neural Networks under Spherically Symmetric Data NeurIPS 2021 Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax Problems NeurIPS 2021 Fast margin maximization via dual acceleration ICML 2021 FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Analysis ICML 2021 Geometry-Aware Gradient Algorithms for Neural Architecture Search ICLR 2021 Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix Factorization NeurIPS 2021 Gradient-Based Algorithms for Machine Teaching CVPR 2021 Gradient-based Hyperparameter Optimization Over Long Horizons NeurIPS 2021 Gradient Descent in RKHS with Importance Labeling AISTATS 2021 Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability ICLR 2021 Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias NeurIPS 2021 Gradient Projection Memory for Continual Learning ICLR 2021 Guarantees for Tuning the Step Size using a Learning-to-Learn Approach ICML 2021 Hadamard Wirtinger Flow for Sparse Phase Retrieval AISTATS 2021 Heavy Ball Neural Ordinary Differential Equations NeurIPS 2021 How Benign is Benign Overfitting ? ICLR 2021 How Data Augmentation affects Optimization for Linear Regression NeurIPS 2021 How Fine-Tuning Allows for Effective Meta-Learning NeurIPS 2021 How Much Over-parameterization Is Sufficient to Learn Deep ReLU Networks? ICLR 2021 IDARTS: Interactive Differentiable Architecture Search ICCV 2021 Implicit Gradient Regularization ICLR 2021 Implicit rate-constrained optimization of non-decomposable objectives ICML 2021 Implicit Regularization in Matrix Sensing via Mirror Descent NeurIPS 2021