conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel NIPS 2021
Path Length Bounds for Gradient Descent and Flow JMLR 2021
Understanding End-to-End Model-Based Reinforcement Learning Methods as Implicit Parameterization NIPS 2021
The Dynamics of Gradient Descent for Overparametrized Neural Networks L4DC 2021
Learning the Dynamics of Time Delay Systems with Trainable Delays L4DC 2021
Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detection INTERSPEECH 2021
An algorithmic view of L2 regularization and some path-following algorithms JMLR 2021
Online Convex Optimization with Continuous Switching Constraint NIPS 2021
Implicit Regularization in ReLU Networks with the Square Loss COLT 2021
When does gradient descent with logistic loss interpolate using deep networks with smoothed ReLU activations? COLT 2021
Numerical influence of ReLU’(0) on backpropagation NIPS 2021
Rank-one matrix estimation: analytic time evolution of gradient descent dynamics COLT 2021
Enhancing Parameter-Free Frank Wolfe with an Extra Subproblem AAAI 2021
Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias NIPS 2021
Parametric Complexity Bounds for Approximating PDEs with Neural Networks NIPS 2021
Semi-Supervised Learning with Meta-Gradient AISTATS 2021
Hadamard Wirtinger Flow for Sparse Phase Retrieval AISTATS 2021
A Study of Condition Numbers for First-Order Optimization AISTATS 2021
Anderson acceleration of coordinate descent AISTATS 2021
Noisy Gradient Descent Converges to Flat Minima for Nonconvex Matrix Factorization AISTATS 2021
Gradient Descent in RKHS with Importance Labeling AISTATS 2021
Meta Learning in the Continuous Time Limit AISTATS 2021
When MAML Can Adapt Fast and How to Assist When It Cannot AISTATS 2021
Noether’s Learning Dynamics: Role of Symmetry Breaking in Neural Networks NIPS 2021
SBO-RNN: Reformulating Recurrent Neural Networks via Stochastic Bilevel Optimization NIPS 2021