conftrace_

retrofitting

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

llms (1) inference (1) key-value cache compression (1) throughput increase (1) compression ratio (1)

Papers

Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference ICML 2024