conftrace_

sparse attention

142 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) efficient computing (781) transformer architecture (1560) large language model (13587) inference acceleration (244) vision transformer (1106) computational efficiency (362) self-attention mechanism (352) model compression (3302) multimodal learning (4645)

Papers

LiteFocus: Accelerated Diffusion Inference for Long Audio Synthesis INTERSPEECH 2024
Blur-aware Spatio-temporal Sparse Transformer for Video Deblurring CVPR 2024
Bootstrapping SparseFormers from Vision Foundation Models CVPR 2024
Task-Free Dynamic Sparse Vision Transformer for Continual Learning AAAI 2024
Adapt or Perish: Adaptive Sparse Transformer with Attentive Feature Refinement for Image Restoration CVPR 2024
Learning from Highly Sparse Spatio-temporal Data NIPS 2024
Loki: Low-rank Keys for Efficient Sparse Attention NIPS 2024
SparseFlow: Accelerating Transformers by Sparsifying Information Flows ACL 2024
Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs CVPR 2024
DeformableTST: Transformer for Time Series Forecasting without Over-reliance on Patching NIPS 2024
MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention NIPS 2024
Even Sparser Graph Transformers NIPS 2024
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter ACL 2024
Transformers Can Represent n-gram Language Models NAACL 2024
On Sparse Modern Hopfield Model NIPS 2023
DSVT: Dynamic Sparse Voxel Transformer With Rotated Sets CVPR 2023
Learning a Sparse Transformer Network for Effective Image Deraining CVPR 2023
Adaptive Attention for Sparse-based Long-sequence Transformer ACL 2023
Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection ACL 2023
Exphormer: Sparse Transformers for Graphs ICML 2023
Object as Query: Lifting Any 2D Object Detector to 3D Detection ICCV 2023
Less is More: Focus Attention for Efficient DETR ICCV 2023
Pruning Self-Attention for Zero-Shot Multi-Speaker Text-to-Speech INTERSPEECH 2023
Diffuser: Efficient Transformers with Multi-Hop Attention Diffusion for Long Sequences AAAI 2023
Discriminative Reasoning with Sparse Event Representation for Document-level Event-Event Relation Extraction ACL 2023