key-value cache

VecInfer: Efficient LLM Inference with Low-Bit KV Cache via Outlier-Suppressed Vector Quantization ACL 2026 ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval ACL 2026 AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism ICML 2025 APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs ACL 2025 Block-Attention for Efficient Prefilling ICLR 2025 Boosting Long-Context Information Seeking via Query-Guided Activation Refilling ACL 2025 CIFLEX: Contextual Instruction Flow for Sub-task Execution in Multi-Turn Interactions with a Single On-Device LLM EMNLP 2025 CommVQ: Commutative Vector Quantization for KV Cache Compression ICML 2025 Compute or Load KV Cache? Why Not Both? ICML 2025 Conversational SimulMT: Efficient Simultaneous Translation with Large Language Models ACL 2025 CSR:Achieving 1 Bit Key-Value Cache via Sparse Representation AAAI 2025 Deliberation in Latent Space via Differentiable Cache Augmentation ICML 2025 EdgeInfinite: A Memory-Efficient Infinite-Context Transformer for Edge Devices ACL 2025 EpMAN: Episodic Memory AttentioN for Generalizing to Longer Contexts ACL 2025 FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference ACL 2025 HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment ICLR 2025 HShare: Fast LLM Decoding by Hierarchical Key-Value Sharing ICLR 2025 KVCrush: Key Value Cache size-reduction using similarity in head-behaviour ACML 2025 LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models ICML 2025 Let the Code LLM Edit Itself When You Edit the Code ICLR 2025 Long Context Compression with Activation Beacon ICLR 2025 Lookahead Q-Cache: Achieving More Consistent KV Cache Eviction via Pseudo Query EMNLP 2025 Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization EMNLP 2025 MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization ACL 2025 MoQAE: Mixed-Precision Quantization for Long-Context LLM Inference via Mixture of Quantization-Aware Experts ACL 2025