sparse attention

Sparse is Enough in Scaling Transformers NeurIPS 2021 Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems EMNLP 2021 SPECTRA: Sparse Structured Text Rationalization EMNLP 2021 SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation CVPR 2021 Time Series Domain Adaptation via Sparse Associative Structure Alignment AAAI 2021 Adaptive Transformers for Learning Multimodal Representations ACL 2020 Big Bird: Transformers for Longer Sequences NeurIPS 2020 Blockwise Self-Attention for Long Document Understanding EMNLP 2020 Long Document Ranking with Query-Directed Sparse Transformer EMNLP 2020 SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection NeurIPS 2020 SBAT: Video Captioning with Sparse Boundary-Aware Transformer IJCAI 2020 Sparse and Continuous Attention Mechanisms NeurIPS 2020 Sparse Sinkhorn Attention ICML 2020 The Explanation Game: Towards Prediction Explainability through Sparse Communication EMNLP 2020 Weak-Attention Suppression for Transformer Based Speech Recognition Interspeech 2020 Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models CVPR 2020 Adaptively Sparse Transformers EMNLP 2019 Improving Textual Network Embedding with Global Attention via Optimal Transport ACL 2019 Selective Sparse Sampling for Fine-Grained Image Recognition ICCV 2019 Sparse Sequence-to-Sequence Models ACL 2019 Star-Transformer NAACL 2019 Interpretable Structure Induction via Sparse Attention EMNLP 2018 Sparse and Constrained Attention for Neural Machine Translation ACL 2018 An Interpretable Knowledge Transfer Model for Knowledge Base Completion ACL 2017 A Regularized Framework for Sparse and Structured Neural Attention NeurIPS 2017