conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization ICML 2022
Convergence of Feedback Arc Set-Based Heuristics for Linear Structural Equation Models PGM 2022
Convex Analysis of the Mean Field Langevin Dynamics AISTATS 2022
Adversarial Tracking Control via Strongly Adaptive Online Learning with Memory AISTATS 2022
Gradient Based Clustering ICML 2022
Vanishing Curvature in Randomly Initialized Deep ReLU Networks AISTATS 2022
Super-Acceleration with Cyclical Step-sizes AISTATS 2022
Scaling and Scalability: Provable Nonconvex Low-Rank Tensor Completion AISTATS 2022
Meta-learning via Language Model In-context Tuning ACL 2022
On global convergence of ResNets: From finite to infinite width using linear parameterization NIPS 2022
Understanding Decoupled and Early Weight Decay AAAI 2021
SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients NIPS 2021
When MAML Can Adapt Fast and How to Assist When It Cannot AISTATS 2021
Learning with Gradient Descent and Weakly Convex Losses AISTATS 2021
Meta Learning in the Continuous Time Limit AISTATS 2021
Gradient Descent in RKHS with Importance Labeling AISTATS 2021
Noisy Gradient Descent Converges to Flat Minima for Nonconvex Matrix Factorization AISTATS 2021
Anderson acceleration of coordinate descent AISTATS 2021
A Study of Condition Numbers for First-Order Optimization AISTATS 2021
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix AISTATS 2021
Hadamard Wirtinger Flow for Sparse Phase Retrieval AISTATS 2021
Semi-Supervised Learning with Meta-Gradient AISTATS 2021
Gradient-based Hyperparameter Optimization Over Long Horizons NIPS 2021
How Fine-Tuning Allows for Effective Meta-Learning NIPS 2021
Asynchronous Stochastic Optimization Robust to Arbitrary Delays NIPS 2021