Skip to content
conftrace_

retrieval head

9 papers

Explore in graph

Co-occurring keywords · papers mentioning both

attention head (6) attention mechanism (3) contextual faithfulness (2) retrieval-augmented generation (2) control token (1) long-context language model (1) dense retriever (1) document reranking (1) long-context reasoning (1) long-context llm (1)

Papers

Retrieval Heads are Dynamic ACL 2026 DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations EMNLP 2025 Emergent Symbolic Mechanisms Support Abstract Reasoning in Large Language Models ICML 2025 How Do Large Vision-Language Models See Text in Image? Unveiling the Distinctive Role of OCR Heads EMNLP 2025 Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization ACL 2025 Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking EMNLP 2025 RazorAttention: Efficient KV Cache Compression Through Retrieval Heads ICLR 2025 Retrieval Head Mechanistically Explains Long-Context Factuality ICLR 2025 Understanding Synthetic Context Extension via Retrieval Heads ICML 2025