conftrace_

gradient compression

78 papers

Explore in graph

Co-occurring keywords

communication efficiency (297) distributed learning (563) distributed training (188) stochastic gradient descent (1091) federated learning (1333) distributed optimization (275) model compression (3302) communication compression (55) error feedback (22) stochastic gradient (296)

Papers

Federated Learning with Compression: Unified Analysis and Sharp Guarantees AISTATS 2021
FedBoost: A Communication-Efficient Algorithm for Federated Learning ICML 2020
Quantized Compressive Sampling of Stochastic Gradients for Efficient Communication in Distributed Deep Learning AAAI 2020
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms NIPS 2020
TextHide: Tackling Data Privacy in Language Understanding Tasks EMNLP 2020
A Double Residual Compression Algorithm for Efficient Distributed Learning AISTATS 2020
ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training NIPS 2020
Practical Low-Rank Communication Compression in Decentralized Deep Learning NIPS 2020
On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning AAAI 2020
CSER: Communication-efficient SGD with Error Reset NIPS 2020
Indirect Stochastic Gradient Quantization and Its Application in Distributed Deep Learning AAAI 2020
Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training EMNLP 2019
Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training IJCNLP 2019
Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients NIPS 2019
Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback NIPS 2019
Error Feedback Fixes SignSGD and other Gradient Compression Schemes ICML 2019
Two Tiered Distributed Training Algorithm for Acoustic Modeling INTERSPEECH 2019
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations NIPS 2019
Compressing Gradient Optimizers via Count-Sketches ICML 2019
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-pass Error-Compensated Compression ICML 2019
PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization NIPS 2019
Communication-efficient Distributed SGD with Sketching NIPS 2019
Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization ICML 2018
signSGD: Compressed Optimisation for Non-Convex Problems ICML 2018
GradiVeQ: Vector Quantization for Bandwidth-Efficient Gradient Aggregation in Distributed CNN Training NIPS 2018