← Keywords

non-convex optimization

546 papers

Explore in graph

Also known as

IRLS

Co-occurring keywords

stochastic gradient descent (1088) stochastic optimization (1060) gradient descent (1143) convergence rate (606) convergence analysis (394) variance reduction (520) nonconvex optimization (316) saddle point (95) matrix factorization (529) online learning (1770)

Papers

Adaptive Stochastic Variance Reduction for Non-convex Finite-Sum Minimization NIPS 2022
Differentially Private Federated Learning on Heterogeneous Data AISTATS 2022
Optimality and Stability in Non-Convex Smooth Games JMLR 2022
A general sample complexity analysis of vanilla policy gradient AISTATS 2022
GraB: Finding Provably Better Data Permutations than Random Reshuffling NIPS 2022
On Biased Stochastic Gradient Estimation JMLR 2022
Robustness to Unbounded Smoothness of Generalized SignSGD NIPS 2022
A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks NIPS 2022
A Single-timescale Analysis for Stochastic Approximation with Multiple Coupled Sequences NIPS 2022
Numerical Optimizations for Weighted Low-rank Estimation on Language Models EMNLP 2022
Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays NIPS 2022
Sharp Restricted Isometry Property Bounds for Low-Rank Matrix Recovery Problems with Corrupted Measurements AAAI 2022
Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out ICML 2022
Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling ICML 2022
A Stochastic Bundle Method for Interpolation JMLR 2022
A gradient sampling method with complexity guarantees for Lipschitz functions in high and low dimensions NIPS 2022
Online PAC-Bayes Learning NIPS 2022
Constrained Langevin Algorithms with L-mixing External Random Variables NIPS 2022
The role of optimization geometry in single neuron learning AISTATS 2022
Accelerated Multiplicative Weights Update Avoids Saddle Points Almost Always IJCAI 2022
Non-convex online learning via algorithmic equivalence NIPS 2022
Global Linear and Local Superlinear Convergence of IRLS for Non-Smooth Robust Regression NIPS 2022
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent AISTATS 2022
Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares COLT 2022
Lower Bounds and Nearly Optimal Algorithms in Distributed Learning with Communication Compression NIPS 2022