conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

The interplay between randomness and structure during learning in RNNs NIPS 2020
Learning compositional functions via multiplicative weight updates NIPS 2020
Global Convergence of Deep Networks with One Wide Layer Followed by Pyramidal Topology NIPS 2020
Coresets for Robust Training of Deep Neural Networks against Noisy Labels NIPS 2020
Reparameterizing Mirror Descent as Gradient Descent NIPS 2020
Most ReLU Networks Suffer from $\ell^2$ Adversarial Perturbations NIPS 2020
Parabolic Approximation Line Search for DNNs NIPS 2020
Optimizing Neural Networks via Koopman Operator Theory NIPS 2020
A Fast Anderson-Chebyshev Acceleration for Nonlinear Optimization AISTATS 2020
Learning in Gated Neural Networks AISTATS 2020
Understanding the Disharmony between Weight Normalization Family and Weight Decay AAAI 2020
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation CVPR 2020
Implicit Regularization and Convergence for Weight Normalization NIPS 2020
Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning Approach NIPS 2020
Stochastic Optimization for Performative Prediction NIPS 2020
Agnostic Learning of a Single Neuron with Gradient Descent NIPS 2020
Efficient Online Learning of Optimal Rankings: Dimensionality Reduction via Gradient Descent NIPS 2020
Generalization Bound of Gradient Descent for Non-Convex Metric Learning NIPS 2020
Memory-Efficient Learning of Stable Linear Dynamical Systems for Prediction and Control NIPS 2020
An Efficient Framework for Clustered Federated Learning NIPS 2020
Learning Linear Programs from Optimal Decisions NIPS 2020
Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy NIPS 2020
Optimizing Rank-Based Metrics With Blackbox Differentiation CVPR 2020
Learning Parities with Neural Networks NIPS 2020
Matrix-Free Preconditioning in Online Learning ICML 2019