Skip to content
conftrace_

inter-layer communication

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

low-rank subspace (1) transformer language model (1) feature routing (1) layer communication (1) mechanism analysis (1) residual stream (1) attention head (1) mechanistic interpretability (1) singular value decomposition (1) transformer architecture (1)

Papers

Talking Heads: Understanding Inter-Layer Communication in Transformer Language Models NeurIPS 2024