conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

The Lingering of Gradients: How to Reuse Gradients Over Time NIPS 2018
Optimization Algorithm Inspired Deep Neural Network Structure Design ACML 2018
Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval and Matrix Completion ICML 2018
Understanding Generalization and Optimization Performance of Deep CNNs ICML 2018
A PID Controller Approach for Stochastic Optimization of Deep Networks CVPR 2018
HOUDINI: Lifelong Learning as Program Synthesis NIPS 2018
How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? NIPS 2018
Catalyst for Gradient-based Nonconvex Optimization AISTATS 2018
Learning Time/Memory-Efficient Deep Architectures With Budgeted Super Networks CVPR 2018
Implicit Bias of Gradient Descent on Linear Convolutional Networks NIPS 2018
Global Geometry of Multichannel Sparse Blind Deconvolution on the Sphere NIPS 2018
Shampoo: Preconditioned Stochastic Tensor Optimization ICML 2018
Dynamic Evaluation of Neural Sequence Models ICML 2018
Exact natural gradient in deep linear networks and its application to the nonlinear case NIPS 2018
Gradient Descent for Spiking Neural Networks NIPS 2018
Gradient Layer: Enhancing the Convergence of Adversarial Training for Generative Models AISTATS 2018
Phase Retrieval Under a Generative Prior NIPS 2018
Breaking the Span Assumption Yields Fast Finite-Sum Minimization NIPS 2018
Direct Runge-Kutta Discretization Achieves Acceleration NIPS 2018
Provably Correct Automatic Sub-Differentiation for Qualified Programs NIPS 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path-Integrated Differential Estimator NIPS 2018
Differential Properties of Sinkhorn Approximation for Learning with Wasserstein Distance NIPS 2018
Fast Approximate Natural Gradient Descent in a Kronecker Factored Eigenbasis NIPS 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning NIPS 2018
Implicit Regularization in Matrix Factorization NIPS 2017