conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Monotonic Alpha-divergence Minimisation for Variational Inference JMLR 2023
When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario ACL 2023
Approximate Regions of Attraction in Learning with Decision-Dependent Distributions AISTATS 2023
Deep Neural Collapse Is Provably Optimal for the Deep Unconstrained Features Model NIPS 2023
Regression as Classification: Influence of Task Formulation on Neural Network Features AISTATS 2023
Online Optimization over Riemannian Manifolds JMLR 2023
Gradient Descent in Neural Networks as Sequential Learning in Reproducing Kernel Banach Space ICML 2023
Spurious Valleys and Clustering Behavior of Neural Networks ICML 2023
Trajectory Alignment: Understanding the Edge of Stability Phenomenon via Bifurcation Theory NIPS 2023
Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Sampling ICML 2023
On the Training Instability of Shuffling SGD with Batch Normalization ICML 2023
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers ACL 2023
DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method NIPS 2023
Transformers Learn In-Context by Gradient Descent ICML 2023
Lottery Tickets in Evolutionary Optimization: On Sparse Backpropagation-Free Trainability ICML 2023
Learning threshold neurons via edge of stability NIPS 2023
Unifying Nesterov’s Accelerated Gradient Methods for Convex and Strongly Convex Objective Functions ICML 2023
From Noisy Fixed-Point Iterations to Private ADMM for Centralized and Federated Learning ICML 2023
Forget Unlearning: Towards True Data-Deletion in Machine Learning ICML 2023
Generalized-Smooth Nonconvex Optimization is As Efficient As Smooth Nonconvex Optimization ICML 2023
Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data NIPS 2023
Beyond the Edge of Stability via Two-step Gradient Updates ICML 2023
Gradient Descent Converges Linearly for Logistic Regression on Separable Data ICML 2023
Global Convergence of Over-parameterized Deep Equilibrium Models AISTATS 2023
Mean Estimation of Truncated Mixtures of Two Gaussians: A Gradient Based Approach AAAI 2023