conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

The Limits of Min-Max Optimization Algorithms: Convergence to Spurious Non-Critical Sets ICML 2021
Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax Problems NIPS 2021
A Novel Sequential Coreset Method for Gradient Descent Algorithms ICML 2021
Acceleration via Fractal Learning Rate Schedules ICML 2021
On Learnability via Gradient Method for Two-Layer ReLU Neural Networks in Teacher-Student Setting ICML 2021
Representational aspects of depth and conditioning in normalizing flows ICML 2021
On the Explicit Role of Initialization on the Convergence and Implicit Bias of Overparametrized Linear Networks ICML 2021
On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths ICML 2021
Implicit Regularization in Tensor Factorization ICML 2021
Learning a Universal Template for Few-shot Dataset Generalization ICML 2021
A Modular Analysis of Provable Acceleration via Polyak’s Momentum: Training a Wide ReLU Network and a Deep Linear Network ICML 2021
The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks ICML 2021
Guarantees for Tuning the Step Size using a Learning-to-Learn Approach ICML 2021
Learning a Single Neuron with Bias Using Gradient Descent NIPS 2021
Online Learning for Load Balancing of Unknown Monotone Resource Allocation Games ICML 2021
On Estimation in Latent Variable Models ICML 2021
MARINA: Faster Non-Convex Distributed Learning with Compression ICML 2021
Dueling Convex Optimization ICML 2021
Optimizing Optimizers: Regret-optimal gradient descent algorithms COLT 2021
SA-BNN: State-Aware Binary Neural Network AAAI 2021
Learning Graph Neural Networks with Approximate Gradient Descent AAAI 2021
Discretization Drift in Two-Player Games ICML 2021
Oracle Complexity in Nonsmooth Nonconvex Optimization NIPS 2021
Enhancing the Transferability of Adversarial Attacks Through Variance Tuning CVPR 2021
Large-Scale Meta-Learning with Continual Trajectory Shifting ICML 2021