Skip to content
conftrace_

clustered head attention

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

accuracy deviation (1) k,v cache (1) memory requirement (1) self attention (1) inference latency (1)

Papers

CHAI: Clustered Head Attention for Efficient LLM Inference ICML 2024