Skip to content
conftrace_

mixture of attention head

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

conditional computing (1) sparse gating (1) multi-head attention (1) model scaling (1) mixture of expert (1) conditional computation (1) attention mechanism (1)

Papers

Mixture of Attention Heads: Selecting Attention Heads Per Token EMNLP 2022