conftrace_

2bit

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

throughput (1) tuning free (1) batch size (1) key-value cache (1) quantization (1)

Papers

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache ICML 2024