conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Nonconvex Low-Rank Tensor Completion from Noisy Data NIPS 2019
Distributed Low-rank Matrix Factorization With Exact Consensus NIPS 2019
Ultrametric Fitting by Gradient Descent NIPS 2019
Blended Matching Pursuit NIPS 2019
Accelerating Rescaled Gradient Descent: Fast Optimization of Smooth Functions NIPS 2019
Efficiently escaping saddle points on manifolds NIPS 2019
Efficient Learning of Restricted Boltzmann Machines Using Covariance Estimates ACML 2019
The Role of Memory in Stochastic Optimization UAI 2019
The Complexity of Making the Gradient Small in Stochastic Convex Optimization COLT 2019
Lipschitz Adaptivity with Multiple Learning Rates in Online Learning COLT 2019
Classification using margin pursuit AISTATS 2019
Computation Efficient Coded Linear Transform AISTATS 2019
Local Saddle Point Optimization: A Curvature Exploitation Approach AISTATS 2019
Negative Momentum for Improved Game Dynamics AISTATS 2019
On the Connection Between Learning Two-Layer Neural Networks and Tensor Decomposition AISTATS 2019
Fixing Mini-batch Sequences with Hierarchical Robust Partitioning AISTATS 2019
Multiclass Boosting: Margins, Codewords, Losses, and Algorithms JMLR 2019
Benchmarking Approximate Inference Methods for Neural Structured Prediction NAACL 2019
A Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent ICML 2019
Anytime Online-to-Batch, Optimism and Acceleration ICML 2019
First-Order Algorithms Converge Faster than $O(1/k)$ on Convex Problems ICML 2019
A Dynamical Systems Perspective on Nesterov Acceleration ICML 2019
Game Theoretic Optimization via Gradient-based Nikaido-Isoda Function ICML 2019
Stochastic Iterative Hard Thresholding for Graph-structured Sparsity Optimization ICML 2019
Why do Larger Models Generalize Better? A Theoretical Perspective via the XOR Problem ICML 2019