attention sink

Addressing Exacerbated Attention Sink for Source-Free Cross-Domain Few-Shot Learning CVPR 2026 A Mechanistic Account of Attention Sinks in GPT-2: One Circuit, Broader Implications for Mitigation ACL 2026 Attention Sinks Are Provably Necessary in Softmax Transformers: Evidence from Trigger-Conditional Tasks ACL 2026 LoL: Longer than Longer, Scaling Video Generation to Hour CVPR 2026 SparVAR: Exploring Sparsity in Visual AutoRegressive Modeling for Training-Free Acceleration CVPR 2026 Threshold Differential Attention for Sink-Free, Ultra-Sparse, and Non-Dispersive Language Modeling ACL 2026 EPIC: Efficient Position-Independent Caching for Serving Large Language Models ICML 2025 Interpreting the Repeated Token Phenomenon in Large Language Models ICML 2025 Look Both Ways and No Sink: Converting LLMs into Text Encoders without Training ACL 2025 Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMs EMNLP 2025 When Attention Sink Emerges in Language Models: An Empirical View ICLR 2025 Efficient Streaming Language Models with Attention Sinks ICLR 2024 Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization EMNLP 2024 StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses NeurIPS 2024 Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration ICML 2024