conftrace_

long context inference

5 papers

Explore in graph

Co-occurring keywords

kv cache (74) large language model (13587) kv cache compression (30) long context (121) efficient inference (233) key-value cache (55) dynamic allocation (6) text segmentation (96) token retrieval (6) attention entropy (8)

Papers

LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model ACL 2026
Deep Kernel Fusion for Transformers ACL 2026
MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference NAACL 2025
FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference EMNLP 2025
SnapKV: LLM Knows What You are Looking for Before Generation NIPS 2024