← Keywords

self-attention mechanism

350 papers

Explore in graph

Also known as

MHSA SACC CSA SA SAM

Co-occurring keywords

transformer architecture (1555) vision transformer (1091) attention mechanism (3975) transformer model (1988) neural network (6616) representation learning (6174) text classification (6776) graph neural network (3945) neural network optimization (1293) computational efficiency (358)

Papers

Unsupervised Abstractive Dialogue Summarization for Tete-a-Tetes AAAI 2021
Self-Attention Graph Residual Convolutional Networks for Event Detection with dependency relations EMNLP 2021
Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction AAAI 2021
Personalized Outfit Recommendation With Learnable Anchors CVPR 2021
Post-Training Quantization for Vision Transformer NIPS 2021
ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias NIPS 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning NIPS 2021
Do Transformers Really Perform Badly for Graph Representation? NIPS 2021
Cross-view Geo-localization with Layer-to-Layer Transformer NIPS 2021
Focal Attention for Long-Range Interactions in Vision Transformers NIPS 2021
Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method NIPS 2021
The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models IJCNLP 2021
End-to-End Lane Shape Prediction With Transformers WACV 2021
Temporal Context Aggregation for Video Retrieval With Contrastive Learning WACV 2021
Spatial Context-Aware Self-Attention Model for Multi-Organ Segmentation WACV 2021
Towards Consumer Loan Fraud Detection: Graph Neural Networks with Role-Constrained Conditional Random Field AAAI 2021
DA-Transformer: Distance-aware Transformer NAACL 2021
AutoAttend: Automated Attention Representation Search ICML 2021
SparseBERT: Rethinking the Importance Analysis in Self-attention ICML 2021
Linear Transformers Are Secretly Fast Weight Programmers ICML 2021
Multi-Scale Matching Networks for Semantic Correspondence ICCV 2021
Rethinking and Improving Relative Position Encoding for Vision Transformer ICCV 2021
PILOT: Introducing Transformers for Probabilistic Sound Event Localization INTERSPEECH 2021
Evidence Aware Neural Pornographic Text Identification for Child Protection AAAI 2021
A Supervised Multi-Head Self-Attention Network for Nested Named Entity Recognition AAAI 2021