weight quantization

Delta-CoMe: Training-Free Delta-Compression with Mixed-Precision for Large Language Models NeurIPS 2024 DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs NeurIPS 2024 Evaluating Quantized Large Language Models ICML 2024 Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation AAAI 2024 Exploring Quantization for Efficient Pre-Training of Transformer Language Models EMNLP 2024 Fast Matrix Multiplications for Lookup Table-Quantized LLMs EMNLP 2024 LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024 LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models ICLR 2024 MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantization NeurIPS 2024 Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models NeurIPS 2024 Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models AAAI 2024 OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models ICLR 2024 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training AAAI 2024 On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization COLING 2024 Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024 OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models AAAI 2024 PB-LLM: Partially Binarized Large Language Models ICLR 2024 QBB: Quantization with Binary Bases for LLMs NeurIPS 2024 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 Rethinking Channel Dimensions to Isolate Outliers for Low-bit Weight Quantization of Large Language Models ICLR 2024 RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024 ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization NeurIPS 2024 SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NeurIPS 2024 TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024