← Keywords

convergence analysis

394 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1088) convergence rate (606) stochastic optimization (1060) non-convex optimization (546) gradient descent (1143) federated learning (1320) neural network optimization (1293) reinforcement learning (4122) distributed learning (563) neural network (6616)

Papers

Non-asymptotic Convergence of Adam-type Reinforcement Learning Algorithms under Markovian Sampling AAAI 2021
Convergence of adaptive algorithms for constrained weakly convex optimization NIPS 2021
FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Analysis ICML 2021
Functional Space Analysis of Local GAN Convergence ICML 2021
One-pass Stochastic Gradient Descent in overparametrized two-layer neural networks AISTATS 2021
Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021
On Characterizing GAN Convergence Through Proximal Duality Gap ICML 2021
EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback NIPS 2021
Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency AISTATS 2021
On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithms NIPS 2021
Federated Learning with Compression: Unified Analysis and Sharp Guarantees AISTATS 2021
Approximate Newton Methods JMLR 2021
Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis NIPS 2021
Faster Directional Convergence of Linear Neural Networks under Spherically Symmetric Data NIPS 2021
Bilevel Optimization: Convergence Analysis and Enhanced Design ICML 2021
The Influence of Memory in Multi-Agent Consensus AAAI 2021
Towards Understanding Why Lookahead Generalizes Better Than SGD and Beyond NIPS 2021
Large Batch Optimization for Deep Learning Using New Complete Layer-Wise Adaptive Rate Scaling AAAI 2021
Prosodic Accommodation in Face-to-Face and Telephone Dialogues INTERSPEECH 2021
Particle Dual Averaging: Optimization of Mean Field Neural Network with Global Convergence Rate Analysis NIPS 2021
The Limits of Min-Max Optimization Algorithms: Convergence to Spurious Non-Critical Sets ICML 2021
Convergence rates and approximation results for SGD and its continuous-time counterpart COLT 2021
A Convergence Analysis of Gradient Descent on Graph Neural Networks NIPS 2021
Approximate Midpoint Policy Iteration for Linear Quadratic Control L4DC 2021
Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems NIPS 2021