Distributed Optimization

Relaxing the Additivity Constraints in Decentralized No-Regret High-Dimensional Bayesian Optimization ICLR 2024 SLowcalSGD : Slow Query Points Improve Local-SGD for Stochastic Convex Optimization NeurIPS 2024 SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization NeurIPS 2024 The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication COLT 2024 The Sample-Communication Complexity Trade-off in Federated Q-Learning NeurIPS 2024 A^2CiD^2: Accelerating Asynchronous Communication in Decentralized Deep Learning NeurIPS 2023 Asynchronous Distributed Bilevel Optimization ICLR 2023 Beyond ADMM: A Unified Client-Variance-Reduced Adaptive Federated Learning Framework AAAI 2023 Beyond Spectral Gap: The Role of the Topology in Decentralized Learning JMLR 2023 Delayed Algorithms for Distributed Stochastic Weakly Convex Optimization NeurIPS 2023 Distributed Bundle Adjustment with Block-Based Sparse Matrix Compression for Super Large Scale Datasets ICCV 2023 Distributed Projection-Free Online Learning for Smooth and Convex Losses AAAI 2023 Distributed Stochastic Nested Optimization for Emerging Machine Learning Models: Algorithm and Theory AAAI 2023 Mobilizing Personalized Federated Learning in Infrastructure-Less and Heterogeneous Environments via Random Walk Stochastic ADMM NeurIPS 2023 Optimal Shrinkage for Distributed Second-Order Optimization ICML 2023 Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization AAAI 2023 Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm NeurIPS 2023 Unbiased Compression Saves Communication in Distributed Optimization: When and How Much? NeurIPS 2023 A Stochastic Linearized Augmented Lagrangian Method for Decentralized Bilevel Optimization NeurIPS 2022 Beyond spectral gap: the role of the topology in decentralized learning NeurIPS 2022 Communication Acceleration of Local Gradient Methods via an Accelerated Primal-Dual Algorithm with an Inexact Prox NeurIPS 2022 Decentralized Local Stochastic Extra-Gradient for Variational Inequalities NeurIPS 2022 Decentralized Training of Foundation Models in Heterogeneous Environments NeurIPS 2022 Distributed Online Convex Optimization with Compressed Communication NeurIPS 2022 Escaping Saddle Points with Bias-Variance Reduced Local Perturbed SGD for Communication Efficient Nonconvex Distributed Learning NeurIPS 2022