conftrace_

error compensation

13 papers

Explore in graph

Co-occurring keywords

gradient compression (78) stochastic gradient descent (1091) communication efficiency (297) distributed learning (563) large language model (13587) communication compression (55) distributed optimization (275) gradient sparsification (16) distributed training (188) variance reduction (523)

Papers

RILQ: Rank-Insensitive LoRA-Based Quantization Error Compensation for Boosting 2-Bit Large Language Model Accuracy AAAI 2025
FlowTrack: Revisiting Optical Flow for Long-Range Dense Tracking CVPR 2024
Enhancing Multimodal Emotion Recognition through ASR Error Compensation and LLM Fine-Tuning INTERSPEECH 2024
Catalyst Acceleration of Error Compensated Methods Leads to Better Communication Complexity AISTATS 2023
ErrorCompensatedX: error compensation for variance reduced algorithms NIPS 2021
1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed ICML 2021
Error Compensated Distributed SGD Can Be Accelerated NIPS 2021
Linearly Converging Error Compensated SGD NIPS 2020
The Error-Feedback framework: SGD with Delayed Gradients JMLR 2020
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations NIPS 2019
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-pass Error-Compensated Compression ICML 2019
Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization ICML 2018
Sparsified SGD with Memory NIPS 2018