4-bit quantization

BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devices CVPR 2025 Memory-Efficient 4-bit Preconditioned Stochastic Optimization ICCV 2025 Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models ACL 2025 Pioneering 4-Bit FP Quantization for Diffusion Models: Mixup-Sign Quantization and Timestep-Aware Fine-Tuning CVPR 2025 QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache ICML 2025 QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edge CVPR 2025 SVDQuant: Absorbing Outliers by Low-Rank Component for 4-Bit Diffusion Models ICLR 2025 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats ICLR 2023 Lossless 4-bit Quantization of Architecture Compressed Conformer ASR Systems on the 300-hr Switchboard Corpus Interspeech 2023 OPTQ: Accurate Quantization for Generative Pre-trained Transformers ICLR 2023 4-bit Conformer with Native Quantization Aware Training for Speech Recognition Interspeech 2022 Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization Interspeech 2022 Towards Green ASR: Lossless 4-bit Quantization of a Hybrid TDNN System on the 300-hr Swithboard Corpus Interspeech 2022 Post training 4-bit quantization of convolutional networks for rapid-deployment NeurIPS 2019