Skip to content
conftrace_

layer communication

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

mechanism analysis (1) feature routing (1) transformer language model (1) low-rank subspace (1) inter-layer communication (1) residual stream (1) attention head (1) mechanistic interpretability (1) singular value decomposition (1) transformer architecture (1)

Papers

Talking Heads: Understanding Inter-Layer Communication in Transformer Language Models NeurIPS 2024