Distributed Optimization

Local Composite Saddle Point Optimization ICLR 2024 On the Effect of Batch Size in Byzantine-Robust Distributed Learning ICLR 2024 The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication COLT 2024 Asynchronous Distributed Bilevel Optimization ICLR 2023 Debiased Distributed Learning for Sparse Partial Linear Models in High Dimensions JMLR 2022 Decentralized Learning for Overparameterized Problems: A Multi-Agent Kernel Approximation Approach ICLR 2022 Decentralized Training of Foundation Models in Heterogeneous Environments NeurIPS 2022 IntSGD: Adaptive Floatless Compression of Stochastic Gradients ICLR 2022 Lower Bounds and Nearly Optimal Algorithms in Distributed Learning with Communication Compression NeurIPS 2022 On Distributed Adaptive Optimization with Gradient Compression ICLR 2022 On the Convergence of Decentralized Adaptive Gradient Methods ACML 2022 Permutation Compressors for Provably Faster Distributed Nonconvex Optimization ICLR 2022 A Better Alternative to Error Feedback for Communication-Efficient Distributed Learning ICLR 2021 Byzantine-Resilient Non-Convex Stochastic Gradient Descent ICLR 2021 Communication-Aware Collaborative Learning AAAI 2021 DeEPCA: Decentralized Exact PCA with Linear Convergence Rate JMLR 2021 Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent ICLR 2021 Linear Convergent Decentralized Optimization with Compression ICLR 2021 Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices NeurIPS 2021 Multi-Level Local SGD: Distributed SGD for Heterogeneous Hierarchical Networks ICLR 2021 New Bounds For Distributed Mean Estimation and Variance Reduction ICLR 2021 Smoothness Matrices Beat Smoothness Constants: Better Communication Compression Techniques for Distributed Optimization NeurIPS 2021 Taming Communication and Sample Complexities in Decentralized Policy Evaluation for Cooperative Multi-Agent Reinforcement Learning NeurIPS 2021 The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication COLT 2021 Distributed High-dimensional Regression Under a Quantile Loss Function JMLR 2020