← Optimization & Theory
Machine Learning › Optimization & Theory ›

Distributed Learning

1100 directly classified papers

Papers per year

Papers

Gradient Forward-Propagation for Large-Scale Temporal Video Modelling CVPR 2021
Distributed Ranking with Communications: Approximation Analysis and Applications AAAI 2021
Model-Contrastive Federated Learning CVPR 2021
Multi-Institutional Collaborations for Improving Deep Learning-Based Magnetic Resonance Image Reconstruction Using Federated Learning CVPR 2021
TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models ICML 2021
Asynchronous Decentralized Optimization With Implicit Stochastic Variance Reduction ICML 2021
Communication Efficient SGD via Gradient Sampling With Bayes Prior CVPR 2021
Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning) NIPS 2021
Towards Tight Communication Lower Bounds for Distributed Optimisation NIPS 2021
Optimal Complexity in Decentralized Training ICML 2021
One-Round Communication Efficient Distributed M-Estimation AISTATS 2021
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models ICML 2021
Leveraging Spatial and Temporal Correlations in Sparsified Mean Estimation NIPS 2021
Quasi-global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data ICML 2021
Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021
Decentralised Learning from Independent Multi-Domain Labels for Person Re-Identification AAAI 2021
Elastic Consistency: A Practical Consistency Model for Distributed Stochastic Gradient Descent AAAI 2021
An Improved Analysis of Gradient Tracking for Decentralized Machine Learning NIPS 2021
Differentially Private Aggregation in the Shuffle Model: Almost Central Accuracy in Almost a Single Message ICML 2021
FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Analysis ICML 2021
From Local to Global Norm Emergence: Dissolving Self-reinforcing Substructures with Incremental Social Instruments ICML 2021
Memory-Efficient Pipeline-Parallel DNN Training ICML 2021
Revealing and Protecting Labels in Distributed Training NIPS 2021
LENA: Communication-Efficient Distributed Learning with Self-Triggered Gradient Uploads AISTATS 2021
Byzantine-Resilient High-Dimensional SGD with Local Iterations on Heterogeneous Data ICML 2021