conftrace_

sparse attention

142 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) efficient computing (781) transformer architecture (1560) large language model (13587) inference acceleration (244) vision transformer (1106) computational efficiency (362) self-attention mechanism (352) model compression (3302) multimodal learning (4645)

Papers

Kernel Multimodal Continuous Attention NIPS 2022
SwinBERT: End-to-End Transformers With Sparse Attention for Video Captioning CVPR 2022
MATE: Multi-view Attention for Table Transformer Efficiency EMNLP 2021
Is Sparse Attention more Interpretable? IJCNLP 2021
Hurdles to Progress in Long-form Question Answering NAACL 2021
SparseBERT: Rethinking the Importance Analysis in Self-attention ICML 2021
Is Sparse Attention more Interpretable? ACL 2021
Multimodal Phased Transformer for Sentiment Analysis EMNLP 2021
SPECTRA: Sparse Structured Text Rationalization EMNLP 2021
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems EMNLP 2021
Combiner: Full Attention Transformer with Sparse Computation Cost NIPS 2021
Time Series Domain Adaptation via Sparse Associative Structure Alignment AAAI 2021
Sparse is Enough in Scaling Transformers NIPS 2021
Scatterbrain: Unifying Sparse and Low-rank Attention NIPS 2021
Sparse Attention with Linear Units EMNLP 2021
SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation CVPR 2021
Image Super-Resolution With Non-Local Sparse Attention CVPR 2021
Dual Sparse Attention Network For Session-based Recommendation AAAI 2021
HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization EMNLP 2021
SBAT: Video Captioning with Sparse Boundary-Aware Transformer IJCAI 2020
Sparse and Continuous Attention Mechanisms NIPS 2020
Sparse Sinkhorn Attention ICML 2020
The Explanation Game: Towards Prediction Explainability through Sparse Communication EMNLP 2020
Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models CVPR 2020
Weak-Attention Suppression for Transformer Based Speech Recognition INTERSPEECH 2020