convergence analysis

Tending Towards Stability: Convergence Challenges in Small Language Models EMNLP 2024 The Implicit Bias of Adam on Separable Data NeurIPS 2024 Tighter Convergence Bounds for Shuffled SGD via Primal-Dual Perspective NeurIPS 2024 Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of Experts AISTATS 2024 Towards Exact Gradient-based Training on Analog In-memory Computing NeurIPS 2024 Towards Robust Learning to Optimize with Theoretical Guarantees CVPR 2024 Training Dynamics of Multi-Head Softmax Attention for In-Context Learning: Emergence, Convergence, and Optimality (extended abstract) COLT 2024 Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression NeurIPS 2024 Trust Region Methods for Nonconvex Stochastic Optimization beyond Lipschitz Smoothness AAAI 2024 Understanding Convergence and Generalization in Federated Learning through Feature Learning Theory ICLR 2024 Understanding Progressive Training Through the Framework of Randomized Coordinate Descent AISTATS 2024 Unraveling the Gradient Descent Dynamics of Transformers NeurIPS 2024 Wasserstein convergence of Cech persistence diagrams for samplings of submanifolds NeurIPS 2024 Weaker MVI Condition: Extragradient Methods with Multi-Step Exploration ICLR 2024 Accelerated Stochastic Optimization Methods under Quasar-convexity ICML 2023 Achieving Linear Speedup in Non-IID Federated Bilevel Learning ICML 2023 A General Theory for Federated Optimization with Asynchronous and Heterogeneous Clients Updates JMLR 2023 Agnostic Learning of General ReLU Activation Using Gradient Descent ICLR 2023 A Guide Through the Zoo of Biased SGD NeurIPS 2023 Analyzing Convergence in Quantum Neural Networks: Deviations from Neural Tangent Kernels ICML 2023 A Non-parametric View of FedAvg and FedProx:Beyond Stationary Points JMLR 2023 A Structural Complexity Analysis of Synchronous Dynamical Systems AAAI 2023 Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic Guarantees JMLR 2023 A Theoretical Analysis of the Learning Dynamics under Class Imbalance ICML 2023 Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity ICML 2023