conftrace_

selective fetching

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

bandwidth-efficient (1) cached history (1) attention layer (1) llm inference (1) data transfer (1)

Papers

SparQ Attention: Bandwidth-Efficient LLM Inference ICML 2024