Skip to content
conftrace_

attention compression

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

transformer compression (1) parameter redundancy (1) group constraint (1) self-attention operator (1) self-supervised grouping (1) head pruning (1) transformer model (1) multi-head attention (1) diffusion transformer (1) window attention (1)

Papers

DiTFastAttn: Attention Compression for Diffusion Transformer Models NeurIPS 2024 Finding the Pillars of Strength for Multi-Head Attention ACL 2023