kv cache

RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations IJCAI 2025 SCOPE: Optimizing Key-Value Cache Compression in Long-context Generation ACL 2025 SemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching IJCNLP 2025 Smarter, Not Harder: Training-Free Adaptive Computation for Transformers ACL 2025 Source-primed Multi-turn Conversation Helps Large Language Models Translate Documents EMNLP 2025 SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers ACL 2025 SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget ICLR 2025 Squeezed Attention: Accelerating Long Context Length LLM Inference ACL 2025 Streamlining the Collaborative Chain of Models into A Single Forward Pass in Generation-Based Tasks ACL 2025 SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation EMNLP 2025 TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization ACL 2025 Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem? ACL 2025 TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection EMNLP 2025 TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Model CVPR 2025 Towards Economical Inference: Enabling DeepSeek’s Multi-Head Latent Attention in Any Transformer-based LLMs ACL 2025 TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text EMNLP 2025 UNComp: Can Matrix Entropy Uncover Sparsity? — A Compressor Design from an Uncertainty-Aware Perspective EMNLP 2025 Unifying Mixture of Experts and Multi-Head Latent Attention for Efficient Language Models EMNLP 2025 Value Residual Learning ACL 2025 VL-Cache: Sparsity and Modality-Aware KV Cache Compression for Vision-Language Model Inference Acceleration ICLR 2025 XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression EMNLP 2025 Bifurcated Attention for Single-Context Large-Batch Sampling ICML 2024 Block Transformer: Global-to-Local Language Modeling for Fast Inference NeurIPS 2024 ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition ACL 2024 DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NeurIPS 2024