Skip to content
conftrace_

sparse attention

177 papers

Papers

FlashMask: Efficient and Rich Mask Extension of FlashAttention ICLR 2025 FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference ICLR 2025 Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesis ICCV 2025 From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency ICLR 2025 GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesis CVPR 2025 HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference ACL 2025 INS: Interaction-aware Synthesis to Enhance Offline Multi-agent Reinforcement Learning ICLR 2025 Iterative Sparse Attention for Long-sequence Recommendation AAAI 2025 LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models ICCV 2025 MalDetectFormer: Leveraging Sparse SpatioTemporal Information for Effective Malicious Traffic Detection AAAI 2025 MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention ICML 2025 Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention ACL 2025 PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity ICCV 2025 SAMBLE: Shape-Specific Point Cloud Sampling for an Optimal Trade-Off Between Local Detail and Global Uniformity CVPR 2025 SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fields ICML 2025 SMamba: Sparse Mamba for Event-based Object Detection AAAI 2025 SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference ICML 2025 Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs ACL 2025 SparseVILA: Decoupling Visual Sparsity for Efficient VLM Inference ICCV 2025 SparX: A Sparse Cross-Layer Connection Mechanism for Hierarchical Vision Mamba and Transformer Networks AAAI 2025 Squeezed Attention: Accelerating Long Context Length LLM Inference ACL 2025 STCOcc: Sparse Spatial-Temporal Cascade Renovation for 3D Occupancy and Scene Flow Prediction CVPR 2025 Structural Deep Encoding for Table Question Answering ACL 2025 Text Compression for Efficient Language Generation NAACL 2025 TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention ICLR 2025