activation quantization

MobileQuant: Mobile-friendly Quantization for On-device Language Models EMNLP 2024 Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models AAAI 2024 OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models ICLR 2024 On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization COLING 2024 Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization EMNLP 2024 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 Towards Accurate Post-training Quantization for Diffusion Models CVPR 2024 What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024 Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats ICLR 2023 Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization EMNLP 2023 LLM-FP4: 4-Bit Floating-Point Quantized Transformers EMNLP 2023 NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers CVPR 2023 Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing NeurIPS 2023 SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023 BiT: Robustly Binarized Multi-distilled Transformer NeurIPS 2022 Fine-tuning Language Models over Slow Networks using Activation Quantization with Guarantees NeurIPS 2022 Learnable Lookup Table for Neural Network Quantization CVPR 2022 QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization ICLR 2022 ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers NeurIPS 2022 ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training ICML 2021 Automated Log-Scale Quantization for Low-Cost Deep Neural Networks CVPR 2021 Optimizing Information Theory Based Bitwise Bottlenecks for Efficient Mixed-Precision Activation Quantization AAAI 2021 QPP: Real-Time Quantization Parameter Prediction for Deep Neural Networks CVPR 2021 Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks AAAI 2021 AdaBits: Neural Network Quantization With Adaptive Bit-Widths CVPR 2020