Yuval Ran-Milo
4 papers · 2024–2026 · 2 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
🌉
Interdisciplinary Bridge
🧭
Keyword Pioneer
🌍
Conference Polyglot
(2)
🐝
Cross-Pollinator
(13)
Conferences
ACL (3)
NIPS (1)
Top co-authors
Keywords
attention sink
(2)
state space model
(2)
factual knowledge
(1)
state-space model
(1)
positional encoding
(1)
self-attention model
(1)
causal intervention
(1)
information flow
(1)
layer-wise dynamics
(1)
complex parameterization
(1)
diagonal structure
(1)
softmax transformer
(1)
trigger-conditional task
(1)
relu attention
(1)
learning theory
(1)
query bia
(1)
attention mechanism
(1)
Papers
Attention Sinks Are Provably Necessary in Softmax Transformers: Evidence from Trigger-Conditional Tasks
ACL 2026
A Mechanistic Account of Attention Sinks in GPT-2: One Circuit, Broader Implications for Mitigation
ACL 2026
Mamba Knockout for Unraveling Factual Information Flow
ACL 2025
Provable Benefits of Complex Parameterizations for Structured State Space Models
NIPS 2024