weight quantization

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP 2024 What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024 2-bit Conformer quantization for automatic speech recognition Interspeech 2023 ASkewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks AISTATS 2023 Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization EMNLP 2023 Jumping through Local Minima: Quantization in the Loss Landscape of Vision Transformers ICCV 2023 Lossy and Lossless (L2) Post-training Model Size Compression ICCV 2023 Model Compression for DNN-based Speaker Verification Using Weight Quantization Interspeech 2023 NIPQ: Noise Proxy-Based Integrated Pseudo-Quantization CVPR 2023 On Quantizing Implicit Neural Representations WACV 2023 OPTQ: Accurate Quantization for Generative Pre-trained Transformers ICLR 2023 Oscillation-free Quantization for Low-bit Vision Transformers ICML 2023 Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantisation. NeurIPS 2023 Quantized Distributed Training of Large Models with Convergence Guarantees ICML 2023 Resilient Binary Neural Network AAAI 2023 SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023 SparseGPT: Massive Language Models Can be Accurately Pruned in One-Shot ICML 2023 Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023 Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers NeurIPS 2023 Understanding weight-magnitude hyperparameters in training binary networks ICLR 2023 Watermarking LLMs with Weight Quantization EMNLP 2023 Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization Interspeech 2022 BiT: Robustly Binarized Multi-distilled Transformer NeurIPS 2022 Elastic-Link for Binarized Neural Networks AAAI 2022 Finding Nearly Everything within Random Binary Networks AISTATS 2022