kv cache quantization

Efficient Multimodal Large Language Model via Dynamic KV Cache Quantization AAAI 2026 MixKVQ: Query-Aware Mixed-Precision KV Cache Quantization for Long-Context Reasoning ACL 2026 Accurate KV Cache Quantization with Outlier Tokens Tracing ACL 2025 AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations COLING 2025 KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference ICML 2025 MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference ACL 2025 QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead AAAI 2025 RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations IJCAI 2025 XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression EMNLP 2025 Evaluating Quantized Large Language Models ICML 2024 KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization NeurIPS 2024 ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification NeurIPS 2024