gradient quantization

BitDP: Ultra-low-bit Communication for Data Parallelism in LLM Training AAAI 2026 Quantized Stochastic Primal–Dual Methods for Distributed Optimization under Relaxed Global Geometry UAI 2026 GradQ-ViT: Robust and Efficient Gradient Quantization for Vision Transformers AAAI 2025 Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats ICLR 2023 Few-bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction ICML 2023 Quantized Distributed Training of Large Models with Convergence Guarantees ICML 2023 Training Transformers with 4-bit Integers NeurIPS 2023 Prompt Certified Machine Unlearning with Randomized Gradient Smoothing and Quantization NeurIPS 2022 Distribution Adaptive INT8 Quantization for Training CNNs AAAI 2021 Information-constrained optimization: can adaptive processing of gradients help? NeurIPS 2021 Neural gradients are near-lognormal: improved quantized and sparse training ICLR 2021 NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization JMLR 2021 Revealing and Protecting Labels in Distributed Training NeurIPS 2021 Adaptive Gradient Quantization for Data-Parallel SGD NeurIPS 2020 A Statistical Framework for Low-bitwidth Training of Deep Neural Networks NeurIPS 2020 Don’t Waste Your Bits! Squeeze Activations and Gradients for Deep Neural Networks via TinyScript ICML 2020 FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training NeurIPS 2020 Indirect Stochastic Gradient Quantization and Its Application in Distributed Deep Learning AAAI 2020 On Efficient Constructions of Checkpoints ICML 2020 RATQ: A Universal Fixed-Length Quantizer for Stochastic Optimization AISTATS 2020 Towards Unified INT8 Training for Convolutional Neural Network CVPR 2020 Analysis of Quantized Models ICLR 2019 Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients NeurIPS 2019 Double Quantization for Communication-Efficient Distributed Optimization NeurIPS 2019 Exploring Fast and Communication-Efficient Algorithms in Large-Scale Distributed Networks AISTATS 2019