conftrace_

kv cache compression

30 papers

Explore in graph

Also known as

KV CACHE KV

Co-occurring keywords

large language model (13587) attention mechanism (4001) memory efficiency (261) model compression (3302) kv cache (74) inference optimization (219) long context (121) inference efficiency (248) memory optimization (114) efficient inference (233)

Papers

REAL: REtrieval-reAsoning and Logic-constructed Attention Behaviors for Long-Context KV Cache Compression ACL 2026
Anchoring the Cache: Mitigating Contextual Hallucination in KV-Compressed Long-Context Summarization ACL 2026
Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression ACL 2026
When Efficiency Meets Safety: A Benchmark Security Analysis of KV Cache Compression in Large Language Models ACL 2026
The Pitfalls of KV Cache Compression ACL 2026
HitKV: Activation Frequency Knows Which Tokens Are Important AAAI 2026
FedSEA-LLaMA: A Secure, Efficient and Adaptive Federated Splitting Framework for Large Language Models AAAI 2026
Head-Aware KV Cache Compression for Efficient Visual Autoregressive Modeling AAAI 2026
Sharp Eyes and Memory for VideoLLMs: Information-Aware Visual Token Pruning for Efficient and Reliable VideoLLM Reasoning AAAI 2026
DesireKV: Decoupling Sensitivity and Importance for Reasoning-Aware KV Cache Compression AAAI 2026
KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference AAAI 2026
EvolKV: Evolutionary KV Cache Compression for LLM Inference EMNLP 2025
More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression EMNLP 2025
ClusterAttn: KV Cache Compression under Intrinsic Attention Clustering ACL 2025
TableKV: KV Cache Compression for In-Context Table Processing ACL 2025
Towards Economical Inference: Enabling DeepSeek’s Multi-Head Latent Attention in Any Transformer-based LLMs ACL 2025
FAEDKV: Infinite-Window Fourier Transform for Unbiased KV Cache Compression EMNLP 2025
ZigZagKV: Dynamic KV Cache Compression for Long-context Modeling based on Layer Uncertainty COLING 2025
LVLM-Compress-Bench: Benchmarking the Broader Impact of Large Vision-Language Model Compression NAACL 2025
MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference NAACL 2025
AirCache: Activating Inter-modal Relevancy KV Cache Compression for Efficient Large Vision-Language Model Inference ICCV 2025
ZipVL: Accelerating Vision-Language Models through Dynamic Token Sparsity ICCV 2025
TaDA: Training-free recipe for Decoding with Adaptive KV Cache Compression and Mean-centering ACL 2025
SCA: Selective Compression Attention for Efficiently Extending the Context Window of Large Language Models EMNLP 2024
Eigen Attention: Attention in Low-Rank Space for KV Cache Compression EMNLP 2024