Skip to content
conftrace_

sparse attention

177 papers

Explore in graph

Co-occurring keywords · papers mentioning both

attention mechanism (44) efficient computing (19) transformer architecture (19) large language model (13) inference acceleration (12) computational efficiency (10) vision transformer (10) diffusion model (8) multimodal learning (8) self-attention mechanism (8)

Papers

Training-free and Adaptive Sparse Attention for Efficient Long Video Generation ICCV 2025 VarDrop: Enhancing Training Efficiency by Reducing Variate Redundancy in Periodic Time Series Forecasting AAAI 2025 VIIS: Visible and Infrared Information Synthesis for Severe Low-Light Image Enhancement WACV 2025 Adapt or Perish: Adaptive Sparse Transformer with Attentive Feature Refinement for Image Restoration CVPR 2024 Blur-aware Spatio-temporal Sparse Transformer for Video Deblurring CVPR 2024 Bootstrapping SparseFormers from Vision Foundation Models CVPR 2024 Complex Image-Generative Diffusion Transformer for Audio Denoising Interspeech 2024 DeformableTST: Transformer for Time Series Forecasting without Over-reliance on Patching NeurIPS 2024 Even Sparser Graph Transformers NeurIPS 2024 Learning from Highly Sparse Spatio-temporal Data NeurIPS 2024 LiteFocus: Accelerated Diffusion Inference for Long Audio Synthesis Interspeech 2024 Loki: Low-rank Keys for Efficient Sparse Attention NeurIPS 2024 LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models ICLR 2024 Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs CVPR 2024 MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention NeurIPS 2024 RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter ACL 2024 SEA: Sparse Linear Attention with Estimated Attention Mask ICLR 2024 Sharing Key Semantics in Transformer Makes Efficient Image Restoration NeurIPS 2024 SparseFlow: Accelerating Transformers by Sparsifying Information Flows ACL 2024 Task-Free Dynamic Sparse Vision Transformer for Continual Learning AAAI 2024 Transformers Can Represent n-gram Language Models NAACL 2024 Adaptive Attention for Sparse-based Long-sequence Transformer ACL 2023 Dialogue State Tracking with Sparse Local Slot Attention ACL 2023 Diffuser: Efficient Transformers with Multi-Hop Attention Diffusion for Long Sequences AAAI 2023 Discriminative Reasoning with Sparse Event Representation for Document-level Event-Event Relation Extraction ACL 2023