← Keywords

non-convex optimization

546 papers

Explore in graph

Also known as

IRLS

Co-occurring keywords

stochastic gradient descent (1088) stochastic optimization (1060) gradient descent (1143) convergence rate (606) convergence analysis (394) variance reduction (520) nonconvex optimization (316) saddle point (95) matrix factorization (529) online learning (1770)

Papers

Fine-Grained Analysis of Stability and Generalization for Modern Meta Learning Algorithms NIPS 2022
Improved Convergence Rate of Stochastic Gradient Langevin Dynamics with Variance Reduction and its Application to Optimization NIPS 2022
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent AISTATS 2022
Local and Global Convergence of General Burer-Monteiro Tensor Optimizations AAAI 2022
Scalable Distributional Robustness in a Class of Non-Convex Optimization with Guarantees NIPS 2022
Understanding Gradient Descent on the Edge of Stability in Deep Learning ICML 2022
Momentum Aggregation for Private Non-convex ERM NIPS 2022
Outlier-Robust Sparse Estimation via Non-Convex Optimization NIPS 2022
Approximate Secular Equations for the Cubic Regularization Subproblem NIPS 2022
On Convergence of FedProx: Local Dissimilarity Invariant Bounds, Non-smoothness and Beyond NIPS 2022
Constrained Langevin Algorithms with L-mixing External Random Variables NIPS 2022
Improved Imaging by Invex Regularizers with Global Optima Guarantees NIPS 2022
Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays NIPS 2022
GraB: Finding Provably Better Data Permutations than Random Reshuffling NIPS 2022
Robustness to Unbounded Smoothness of Generalized SignSGD NIPS 2022
A Single-timescale Analysis for Stochastic Approximation with Multiple Coupled Sequences NIPS 2022
Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares COLT 2022
Learning a Single Neuron with Adversarial Label Noise via Gradient Descent COLT 2022
Optimal Algorithms for Stochastic Multi-Level Compositional Optimization ICML 2022
SGD with Coordinate Sampling: Theory and Practice JMLR 2022
AdaGrad Avoids Saddle Points ICML 2022
Towards Optimal Communication Complexity in Distributed Non-Convex Optimization NIPS 2022
Finite-Sum Coupled Compositional Stochastic Optimization: Theory and Applications ICML 2022
Distributed Stochastic Gradient Descent: Nonconvexity, Nonsmoothness, and Convergence to Local Minima JMLR 2022
Oracle Complexity in Nonsmooth Nonconvex Optimization JMLR 2022