Skip to content
conftrace_

weight-only quantization

9 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (5) large language model (4) quantization error (2) low-bit quantization (2) weight quantization (2) model quantization (2) post-training quantization (2) llm inference (1) floating point (1) low-precision approximation (1)

Papers

Price of metric universality in vector quantization is at most 0.11 bit COLT 2026 AMQ: Enabling AutoML for Mixed-precision Weight-Only Quantization of Large Language Models EMNLP 2025 CBQ: Cross-Block Quantization for Large Language Models ICLR 2025 FBQuant: FeedBack Quantization for Large Language Models IJCAI 2025 FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point ACL 2025 QSpec: Speculative Decoding with Complementary Quantization Schemes EMNLP 2025 Why Do Some Inputs Break Low-Bit LLM Quantization? EMNLP 2025 Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024 EasyQuant: An Efficient Data-free Quantization Algorithm for LLMs EMNLP 2023