Distributed Learning

Distributed Least Squares in Small Space via Sketching and Bias Reduction NeurIPS 2024 Don't Compress Gradients in Random Reshuffling: Compress Gradient Differences NeurIPS 2024 Exponential Quantum Communication Advantage in Distributed Inference and Learning NeurIPS 2024 Freya PAGE: First Optimal Time Complexity for Large-Scale Nonconvex Finite-Sum Optimization with Heterogeneous Asynchronous Computations NeurIPS 2024 Implicit Regularization of Decentralized Gradient Descent for Sparse Regression NeurIPS 2024 Improving the Worst-Case Bidirectional Communication Complexity for Nonconvex Distributed Optimization under Function Similarity NeurIPS 2024 Leveraging partial stragglers within gradient coding NeurIPS 2024 LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity NeurIPS 2024 On the Role of Server Momentum in Federated Learning AAAI 2024 Ordered Momentum for Asynchronous SGD NeurIPS 2024 ParaILP: A Parallel Local Search Framework for Integer Linear Programming with Cooperative Evolution Mechanism IJCAI 2024 Provably Convergent Federated Trilevel Learning AAAI 2024 Scalable High-Dimensional Multivariate Linear Regression for Feature-Distributed Data JMLR 2024 SLowcalSGD : Slow Query Points Improve Local-SGD for Stochastic Convex Optimization NeurIPS 2024 SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization NeurIPS 2024 A^2CiD^2: Accelerating Asynchronous Communication in Decentralized Deep Learning NeurIPS 2023 A General Theory for Federated Optimization with Asynchronous and Heterogeneous Clients Updates JMLR 2023 Asynchronous Communication Aware Multi-Agent Task Allocation IJCAI 2023 Buffered Asynchronous SGD for Byzantine Learning JMLR 2023 Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation ICML 2023 Compressed Decentralized Proximal Stochastic Gradient Method for Nonconvex Composite Problems with Heterogeneous Data ICML 2023 Decentralized Learning: Theoretical Optimality and Practical Improvements JMLR 2023 Decentralized Riemannian Algorithm for Nonconvex Minimax Problems AAAI 2023 Delayed Algorithms for Distributed Stochastic Weakly Convex Optimization NeurIPS 2023