gradient compression

SLAMB: Accelerated Large Batch Training with Sparse Communication ICML 2023 SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023 Unbiased Compression Saves Communication in Distributed Optimization: When and How Much? NeurIPS 2023 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation ICML 2022 Communication-Compressed Adaptive Gradient Method for Distributed Nonconvex Optimization AISTATS 2022 Communication-Efficient Adaptive Federated Learning ICML 2022 Communication-efficient Distributed Learning for Large Batch Optimization ICML 2022 Detached Error Feedback for Distributed SGD with Random Sparsification ICML 2022 Distributed adversarial training to robustify deep neural networks at scale UAI 2022 Distributed Online Learning for Joint Regret with Communication Constraints ALT 2022 EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learning ICML 2022 EF-BV: A Unified Theory of Error Feedback and Variance Reduction Mechanisms for Biased and Unbiased Compression in Distributed Optimization NeurIPS 2022 Fine-tuning Language Models over Slow Networks using Activation Quantization with Guarantees NeurIPS 2022 Hierarchical Channel-spatial Encoding for Communication-efficient Collaborative Learning NeurIPS 2022 Intrinsic Gradient Compression for Scalable and Efficient Federated Learning ACL 2022 IntSGD: Adaptive Floatless Compression of Stochastic Gradients ICLR 2022 Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022 On Distributed Adaptive Optimization with Gradient Compression ICLR 2022 ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training ICML 2022 QLSD: Quantised Langevin Stochastic Dynamics for Bayesian Federated Learning AISTATS 2022 Shifted compression framework: generalizations and improvements UAI 2022 SmartIdx: Reducing Communication Cost in Federated Learning by Exploiting the CNNs Structures AAAI 2022 A Flexible Framework for Communication-Efficient Machine Learning AAAI 2021 Communication-Efficient Frank-Wolfe Algorithm for Nonconvex Decentralized Distributed Learning AAAI 2021 Communication Efficient SGD via Gradient Sampling With Bayes Prior CVPR 2021