self-attention mechanism

Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting AAAI 2021 Intriguing Properties of Vision Transformers NeurIPS 2021 Linear Transformers Are Secretly Fast Weight Programmers ICML 2021 Line Segment Detection Using Transformers Without Edges CVPR 2021 Lipschitz normalization for self-attention layers with application to graph neural networks ICML 2021 Long-Short Transformer: Efficient Transformers for Language and Vision NeurIPS 2021 Multi-Scale Matching Networks for Semantic Correspondence ICCV 2021 Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention AAAI 2021 PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021 Personalized Outfit Recommendation With Learnable Anchors CVPR 2021 PILOT: Introducing Transformers for Probabilistic Sound Event Localization Interspeech 2021 Pose Recognition With Cascade Transformers CVPR 2021 Post-Training Quantization for Vision Transformer NeurIPS 2021 ProFormer: Towards On-Device LSH Projection Based Transformers EACL 2021 Recurrent Attention for Neural Machine Translation EMNLP 2021 ResT: An Efficient Transformer for Visual Recognition NeurIPS 2021 Rethinking and Improving Relative Position Encoding for Vision Transformer ICCV 2021 Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning NeurIPS 2021 Self-Attention Channel Combinator Frontend for End-to-End Multichannel Far-Field Speech Recognition Interspeech 2021 Self-Attention Graph Residual Convolutional Networks for Event Detection with dependency relations EMNLP 2021 Sequence-to-Sequence Learning for Deep Gaussian Process Based Speech Synthesis Using Self-Attention GP Layer Interspeech 2021 Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding Interspeech 2021 Shifted Chunk Transformer for Spatio-Temporal Representational Learning NeurIPS 2021 Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method NeurIPS 2021 SparseBERT: Rethinking the Importance Analysis in Self-attention ICML 2021