← Keywords

non-convex optimization

546 papers

Explore in graph

Also known as

IRLS

Co-occurring keywords

stochastic gradient descent (1088) stochastic optimization (1060) gradient descent (1143) convergence rate (606) convergence analysis (394) variance reduction (520) nonconvex optimization (316) saddle point (95) matrix factorization (529) online learning (1770)

Papers

Greedy and IHT Algorithms for Non-convex Optimization with Monotone Costs of Non-zeros AISTATS 2019
Learning to Optimize in Swarms NIPS 2019
Computational Separations between Sampling and Optimization NIPS 2019
Faster First-Order Methods for Stochastic Non-Convex Optimization on Riemannian Manifolds AISTATS 2019
Surrogate Losses for Online Learning of Stepsizes in Stochastic Non-Convex Optimization ICML 2019
Momentum-Based Variance Reduction in Non-Convex SGD NIPS 2019
Variance Reduced Policy Evaluation with Smooth Function Approximation NIPS 2019
A Linearly Convergent Method for Non-Smooth Non-Convex Optimization on the Grassmannian with Applications to Robust Subspace and Dictionary Learning NIPS 2019
Trimming the $\ell_1$ Regularizer: Statistical Analysis, Optimization, and Applications to Deep Learning ICML 2019
Who is Afraid of Big Bad Minima? Analysis of gradient-flow in spiked matrix-tensor models NIPS 2019
On the Computation and Communication Complexity of Parallel SGD with Dynamic Batch Sizes for Stochastic Non-Convex Optimization ICML 2019
Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning ICML 2019
How degenerate is the parametrization of neural networks with the ReLU activation function? NIPS 2019
A Sufficient Condition for Convergences of Adam and RMSProp CVPR 2019
Toward Understanding the Importance of Noise in Training Neural Networks ICML 2019
Global Convergence of Block Coordinate Descent in Deep Learning ICML 2019
On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes AISTATS 2019
Efficiently escaping saddle points on manifolds NIPS 2019
Trading Redundancy for Communication: Speeding up Distributed SGD for Non-convex Optimization ICML 2019
Estimating the Fundamental Matrix Without Point Correspondences With Application to Transmission Imaging ICCV 2019
A Well-Tempered Landscape for Non-convex Robust Subspace Recovery JMLR 2019
Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery JMLR 2019
Efficient Smooth Non-Convex Stochastic Compositional Optimization via Stochastic Recursive Gradient Descent NIPS 2019
Non-Convex Matrix Completion and Related Problems via Strong Duality JMLR 2019
Stochastic Optimization for DC Functions and Non-smooth Non-convex Regularizers with Non-asymptotic Convergence ICML 2019