linear attention

Linear Attention Modeling for Learned Image Compression CVPR 2025 Linear Transformers as VAR Models: Aligning Autoregressive Attention Mechanisms with Autoregressive Forecasting ICML 2025 Linear Transformer Topological Masking with Graph Random Features ICLR 2025 LiT: Delving into a Simple Linear Diffusion Transformer for Image Generation ICCV 2025 LiVOS: Light Video Object Segmentation with Gated Linear Matching CVPR 2025 LoLCATs: On Low-Rank Linearizing of Large Language Models ICLR 2025 MixA: A Mixed Attention approach with Stable Lightweight Linear Attention to enhance Efficiency of Vision Transformers at the Edge ICCV 2025 MVA: Linear Attention with High-order Query-Keys Integration and Multi-level Vocabulary Decomposition ICML 2025 On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving ICML 2025 PolaFormer: Polarity-aware Linear Attention for Vision Transformers ICLR 2025 Rectifying Magnitude Neglect in Linear Attention ICCV 2025 Rodimus*: Breaking the Accuracy-Efficiency Trade-Off with Efficient Attentions ICLR 2025 Sample-Efficient Language Modeling with Linear Attention and Lightweight Enhancements EMNLP 2025 SANA: Efficient High-Resolution Text-to-Image Synthesis with Linear Diffusion Transformers ICLR 2025 Sequence Accumulation and Beyond: Infinite Context Length on Single GPU and Large Clusters AAAI 2025 Sparsifying Mamba EMNLP 2025 TabFlex: Scaling Tabular Learning to Millions with Linear Attention ICML 2025 Towards Learning High-Precision Least Squares Algorithms with Sequence Models ICLR 2025 Training Dynamics of In-Context Learning in Linear Attention ICML 2025 Birdie: Advancing State Space Language Modeling with Dynamic Mixtures of Training Objectives EMNLP 2024 Bridging the Divide: Reconsidering Softmax and Linear Attention NeurIPS 2024 Demystify Mamba in Vision: A Linear Attention Perspective NeurIPS 2024 DiJiang: Efficient Large Language Models through Compact Kernelization ICML 2024 Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond NeurIPS 2024 Gated Linear Attention Transformers with Hardware-Efficient Training ICML 2024