sparse attention

DSVT: Dynamic Sparse Voxel Transformer With Rotated Sets CVPR 2023 Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer EMNLP 2023 Exphormer: Sparse Transformers for Graphs ICML 2023 Fast Attention Over Long Sequences With Dynamic Sparse Flash Attention NeurIPS 2023 Learning a Sparse Transformer Network for Effective Image Deraining CVPR 2023 Less is More: Focus Attention for Efficient DETR ICCV 2023 Object as Query: Lifting Any 2D Object Detector to 3D Detection ICCV 2023 On Sparse Modern Hopfield Model NeurIPS 2023 Probabilistic Masked Attention Networks for Explainable Sequential Recommendation IJCAI 2023 Pruning Self-Attention for Zero-Shot Multi-Speaker Text-to-Speech Interspeech 2023 Sparse Modular Activation for Efficient Sequence Modeling NeurIPS 2023 Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers CVPR 2023 Summarizing Multiple Documents with Conversational Structure for Meta-Review Generation EMNLP 2023 SViTT: Temporal Learning of Sparse Video-Text Transformers CVPR 2023 Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection ACL 2023 Beyond Characters: Subword-level Morpheme Segmentation NAACL 2022 ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer ACL 2022 DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization AAAI 2022 Flow-Guided Sparse Transformer for Video Deblurring ICML 2022 Kernel Multimodal Continuous Attention NeurIPS 2022 Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns ACL 2022 Long-range Sequence Modeling with Predictable Sparse Attention ACL 2022 Neural Mesh Simplification CVPR 2022 On the Interpretability of Attention Networks ACML 2022 Predicting Attention Sparsity in Transformers ACL 2022