← Keywords

non-convex optimization

546 papers

Explore in graph

Also known as

IRLS

Co-occurring keywords

stochastic gradient descent (1088) stochastic optimization (1060) gradient descent (1143) convergence rate (606) convergence analysis (394) variance reduction (520) nonconvex optimization (316) saddle point (95) matrix factorization (529) online learning (1770)

Papers

Lower Bounds and Nearly Optimal Algorithms in Distributed Learning with Communication Compression NIPS 2022
Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness ICML 2022
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers ICML 2022
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration JMLR 2022
Asymptotic Study of Stochastic Adaptive Algorithms in Non-convex Landscape JMLR 2022
Numerical Optimizations for Weighted Low-rank Estimation on Language Models EMNLP 2022
On the Oracle Complexity of Higher-Order Smooth Non-Convex Finite-Sum Optimization AISTATS 2022
Scalable Distributional Robustness in a Class of Non-Convex Optimization with Guarantees NIPS 2022
Single Loop Gaussian Homotopy Method for Non-convex Optimization NIPS 2022
Towards Optimal Communication Complexity in Distributed Non-Convex Optimization NIPS 2022
Global Linear and Local Superlinear Convergence of IRLS for Non-Smooth Robust Regression NIPS 2022
Momentum Aggregation for Private Non-convex ERM NIPS 2022
Approximate Secular Equations for the Cubic Regularization Subproblem NIPS 2022
GraB: Finding Provably Better Data Permutations than Random Reshuffling NIPS 2022
Stochastic Sign Descent Methods: New Algorithms and Better Theory ICML 2021
Zeroth-Order Non-Convex Learning via Hierarchical Dual Averaging ICML 2021
Regret Minimization in Stochastic Non-Convex Learning via a Proximal-Gradient Approach ICML 2021
On a Combination of Alternating Minimization and Nesterov’s Momentum ICML 2021
MARINA: Faster Non-Convex Distributed Learning with Compression ICML 2021
Learn2Hop: Learned Optimization on Rough Landscapes ICML 2021
Field of Junctions: Extracting Boundary Structure at Low SNR ICCV 2021
Optimal Non-Convex Exact Recovery in Stochastic Block Model via Projected Power Method ICML 2021
Online stochastic gradient descent on non-convex losses from high-dimensional inference JMLR 2021
Learning-to-learn non-convex piecewise-Lipschitz functions NIPS 2021
The Limits of Min-Max Optimization Algorithms: Convergence to Spurious Non-Critical Sets ICML 2021