conftrace_

polyak-lojasiewicz condition

15 papers

Explore in graph

Also known as

PL CONDITION

Co-occurring keywords

non-convex optimization (547) stochastic gradient descent (1091) convergence rate (607) stochastic optimization (1060) gradient descent (1144) saddle point (95) gradient descent ascent (31) neural network (6616) stochastic method (95) min-max optimization (80)

Papers

Gradient-free optimization of highly smooth functions: improved analysis and a new algorithm JMLR 2024
On the Lower Bound of Minimizing Polyak-Łojasiewicz functions COLT 2023
Fast Objective & Duality Gap Convergence for Non-Convex Strongly-Concave Min-Max Problems with PL Condition JMLR 2023
Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization NIPS 2022
Optimal Algorithms for Stochastic Multi-Level Compositional Optimization ICML 2022
Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness ICML 2022
Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition NIPS 2022
Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity AISTATS 2022
Subquadratic Overparameterization for Shallow Neural Networks NIPS 2021
Direct-Search for a Class of Stochastic Min-Max Problems AISTATS 2021
PAGE: A Simple and Optimal Probabilistic Gradient Estimator for Nonconvex Optimization ICML 2021
SGD for Structured Nonconvex Functions: Learning Rates, Minibatching and Interpolation AISTATS 2021
A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and Performance ICML 2021
Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methods NIPS 2019
Stability and Generalization of Learning Algorithms that Converge to Global Optima ICML 2018