← Keywords

convergence analysis

394 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1088) convergence rate (606) stochastic optimization (1060) non-convex optimization (546) gradient descent (1143) federated learning (1320) neural network optimization (1293) reinforcement learning (4122) distributed learning (563) neural network (6616)

Papers

On Convergence of Distributed Approximate Newton Methods: Globalization, Sharper Bounds and Beyond JMLR 2020
Proximal Gradient Algorithm with Momentum and Flexible Parameter Restart for Nonconvex Optimization IJCAI 2020
Optimization Learning: Perspective, Method, and Applications IJCAI 2020
Understanding the Impact of Model Incoherence on Convergence of Incremental SGD with Random Reshuffle ICML 2020
Training Linear Neural Networks: Non-Local Convergence and Complexity Results ICML 2020
Beyond Trees: Analysis and Convergence of Belief Propagation in Graphs with Multiple Cycles AAAI 2020
Towards Understanding the Dynamics of the First-Order Adversaries ICML 2020
An Improved Analysis of Stochastic Gradient Descent with Momentum NIPS 2020
Optimistic Dual Extrapolation for Coherent Non-monotone Variational Inequalities NIPS 2020
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes JMLR 2020
Structured Policy Iteration for Linear Quadratic Regulator ICML 2020
On Convergence of Nearest Neighbor Classifiers over Feature Transformations NIPS 2020
Stochastic Optimization with Laggard Data Pipelines NIPS 2020
A General System of Differential Equations to Model First-Order Adaptive Algorithms JMLR 2020
On the Acceleration of Deep Learning Model Parallelism With Staleness CVPR 2020
Improved Analysis of Clipping Algorithms for Non-convex Optimization NIPS 2020
Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks NIPS 2020
Zap Q-Learning With Nonlinear Function Approximation NIPS 2020
On the Convergence of Smooth Regularized Approximate Value Iteration Schemes NIPS 2020
Improving Sample Complexity Bounds for (Natural) Actor-Critic Algorithms NIPS 2020
New Insights and Perspectives on the Natural Gradient Method JMLR 2020
On the Convergence of Nesterov’s Accelerated Gradient Method in Stochastic Settings ICML 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates ICML 2020
Over-parameterized Adversarial Training: An Analysis Overcoming the Curse of Dimensionality NIPS 2020
Stochastic Gradient Descent in Correlated Settings: A Study on Gaussian Processes NIPS 2020