Skip to content
conftrace_

accuracy deviation

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

clustered head attention (1) k,v cache (1) memory requirement (1) self attention (1) inference latency (1)

Papers

CHAI: Clustered Head Attention for Efficient LLM Inference ICML 2024