local sgd

EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models ICLR 2025 HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training ICML 2025 Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis AISTATS 2025 SLowcalSGD : Slow Query Points Improve Local-SGD for Stochastic Convex Optimization NeurIPS 2024 The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication COLT 2024 Beyond Lipschitz Smoothness: A Tighter Analysis for Nonconvex Optimization ICML 2023 FedAvg Converges to Zero Training Loss Linearly for Overparameterized Multi-Layer Neural Networks ICML 2023 Global Convergence Analysis of Local SGD for Two-layer Neural Network without Overparameterization NeurIPS 2023 Why (and When) does Local SGD Generalize Better than SGD? ICLR 2023 Hybrid Local SGD for Federated Learning with Heterogeneous Communications ICLR 2022 Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time AISTATS 2022 Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond ICLR 2022 ResIST: Layer-wise decomposition of ResNets for distributed training UAI 2022 Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective AISTATS 2022 Bias-Variance Reduced Local SGD for Less Heterogeneous Federated Learning ICML 2021 Communication-efficient SGD: From Local SGD to One-Shot Averaging NeurIPS 2021 Local SGD: Unified Theory and New Efficient Methods AISTATS 2021 Multi-Level Local SGD: Distributed SGD for Heterogeneous Hierarchical Networks ICLR 2021 On the Convergence of Communication-Efficient Local SGD for Federated Learning AAAI 2021 STL-SGD: Speeding Up Local SGD with Stagewise Communication Period AAAI 2021 A Unified Theory of Decentralized SGD with Changing Topology and Local Updates ICML 2020 Don't Use Large Mini-batches, Use Local SGD ICLR 2020 From Local SGD to Local Fixed-Point Methods for Federated Learning ICML 2020 Is Local SGD Better than Minibatch SGD? ICML 2020 Lower Bounds and Optimal Algorithms for Personalized Federated Learning NeurIPS 2020