conftrace_

sparse attention

142 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) efficient computing (781) transformer architecture (1560) large language model (13587) inference acceleration (244) vision transformer (1106) computational efficiency (362) self-attention mechanism (352) model compression (3302) multimodal learning (4645)

Papers

Adaptive Transformers for Learning Multimodal Representations ACL 2020
Big Bird: Transformers for Longer Sequences NIPS 2020
SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection NIPS 2020
Blockwise Self-Attention for Long Document Understanding EMNLP 2020
Long Document Ranking with Query-Directed Sparse Transformer EMNLP 2020
Selective Sparse Sampling for Fine-Grained Image Recognition ICCV 2019
Sparse Sequence-to-Sequence Models ACL 2019
Adaptively Sparse Transformers IJCNLP 2019
Adaptively Sparse Transformers EMNLP 2019
Star-Transformer NAACL 2019
Improving Textual Network Embedding with Global Attention via Optimal Transport ACL 2019
Interpretable Structure Induction via Sparse Attention EMNLP 2018
Sparse and Constrained Attention for Neural Machine Translation ACL 2018
Jointly Trained Sequential Labeling and Classification by Sparse Attention Neural Networks INTERSPEECH 2017
A Regularized Framework for Sparse and Structured Neural Attention NIPS 2017
An Interpretable Knowledge Transfer Model for Knowledge Base Completion ACL 2017
From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification ICML 2016