gradient sparsity

Acceleration of Backpropagation in Linear Layers of Transformer Models Based on Gradient Structure EACL 2026 CONGO: Compressive Online Gradient Optimization ICLR 2025 LoSiA: Efficient High-Rank Fine-Tuning via Subnet Localization and Optimization EMNLP 2025 Differentially Private Optimization with Sparse Gradients NeurIPS 2024 Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ICML 2024 SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers EMNLP 2024 Sparsity-Preserving Differentially Private Training of Large Embedding Models NeurIPS 2023 SparCL: Sparse Continual Learning on the Edge NeurIPS 2022 Learning where to learn: Gradient sparsity in meta and continual learning NeurIPS 2021 Neural gradients are near-lognormal: improved quantized and sparse training ICLR 2021 Tree-projected gradient descent for estimating gradient-sparse parameters on graphs COLT 2020 Variance Reduction With Sparse Gradients ICLR 2020 Single Image Reflection Suppression CVPR 2017 Image Fusion with Local Spectral Consistency and Dynamic Gradient Sparsity CVPR 2014