conftrace_

optimization theory

45 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) gradient descent (1144) convergence analysis (395) convergence rate (607) convex optimization (1321) neural network optimization (1293) implicit bia (107) neural network (6616) non-convex optimization (547) generalization bound (652)

Papers

Can Implicit Bias Explain Generalization? Stochastic Convex Optimization as a Case Study NIPS 2020
Explore Aggressively, Update Conservatively: Stochastic Extragradient Methods with Variable Stepsize Scaling NIPS 2020
Tight Dimension Independent Lower Bound on the Expected Convergence Rate for Diminishing Step Sizes in SGD NIPS 2019
Differential Equations for Modeling Asynchronous Algorithms IJCAI 2018
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks ICML 2018
Understanding Generalization and Optimization Performance of Deep CNNs ICML 2018
Sharpness, Restart and Acceleration NIPS 2017
Adaptive Relaxed ADMM: Convergence Theory and Practical Implementation CVPR 2017
Failures of Gradient-Based Deep Learning ICML 2017
Matrix Completion has No Spurious Local Minimum NIPS 2016
On the Influence of Momentum Acceleration on Online Learning JMLR 2016
The Power of Optimization from Samples NIPS 2016
On the Global Linear Convergence of Frank-Wolfe Optimization Variants NIPS 2015
Optimization Equivalence of Divergences Improves Neighbor Embedding ICML 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization NIPS 2014
Approximating Semidefinite Programs in Sublinear Time NIPS 2011
Convergence Rates of Inexact Proximal-Gradient Methods for Convex Optimization NIPS 2011
Lower Bounds on Rate of Convergence of Cutting Plane Methods NIPS 2010
On the Convergence of the Concave-Convex Procedure NIPS 2009
Comments on the Complete Characterization of a Family of Solutions to a Generalized Fisher Criterion JMLR 2008