model quantization

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models ICLR 2024 QBB: Quantization with Binary Bases for LLMs NeurIPS 2024 QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning EMNLP 2024 QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models ICLR 2024 QTIP: Quantization with Trellises and Incoherence Processing NeurIPS 2024 Quantization of Large Language Models with an Overdetermined Basis UAI 2024 Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models ACL 2024 QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videos NeurIPS 2024 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models ACL 2024 Retraining-Free Model Quantization via One-Shot Weight-Coupling Learning CVPR 2024 SAML: Speaker Adaptive Mixture of LoRA Experts for End-to-End ASR Interspeech 2024 Sign Value Constraint Decomposition for Efficient 1-Bit Quantization of Speech Translation Tasks Interspeech 2024 SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NeurIPS 2024 StepbaQ: Stepping backward as Correction for Quantized Diffusion Models NeurIPS 2024 TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Tasks ACL 2024 TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024 The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers (Student Abstract) AAAI 2024 TinyAgent: Function Calling at the Edge EMNLP 2024 Understanding and Minimising Outlier Features in Transformer Training NeurIPS 2024 VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP 2024 What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024 When Compression Meets Model Compression: Memory-Efficient Double Compression for Large Language Models EMNLP 2024 Wino Vidi Vici: Conquering Numerical Instability of 8-Bit Winograd Convolution for Accurate Inference Acceleration on Edge WACV 2024 xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024