self attention

Star Attention: Efficient LLM Inference over Long Sequences ICML 2025 Streamline Without Sacrifice - Squeeze out Computation Redundancy in LMM ICML 2025 The underlying structures of self-attention: symmetry, directionality, and emergent dynamics in Transformer training ICML 2025 Aligning Transformers with Weisfeiler-Leman ICML 2024 CHAI: Clustered Head Attention for Efficient LLM Inference ICML 2024 Efficient Vision Transformers with Partial Attention ECCV 2024 Eureka-Moments in Transformers: Multi-Step Tasks Reveal Softmax Induced Optimization Problems ICML 2024 Exploiting the Social-Like Prior in Transformer for Visual Reasoning AAAI 2024 Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level NeurIPS 2024 Fine-grained Local Sensitivity Analysis of Standard Dot-Product Self-Attention ICML 2024 From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers ICML 2024 Generalized Neural Sorting Networks with Error-Free Differentiable Swap Functions ICLR 2024 Gradient-based Visual Explanation for Transformer-based CLIP ICML 2024 Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks ICML 2024 How Smooth Is Attention? ICML 2024 How Transformers Learn Causal Structure with Gradient Descent ICML 2024 Improving Diffusion Models for Authentic Virtual Try-on in the Wild ECCV 2024 KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning ICML 2024 LookupViT: Compressing visual information to a limited number of tokens ECCV 2024 One Meta-tuned Transformer is What You Need for Few-shot Learning ICML 2024 PIDformer: Transformer Meets Control Theory ICML 2024 Polynomial-based Self-Attention for Table Representation Learning ICML 2024 PolySketchFormer: Fast Transformers via Sketching Polynomial Kernels ICML 2024 Positional Knowledge is All You Need: Position-induced Transformer (PiT) for Operator Learning ICML 2024 QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference ICML 2024