← Keywords

self-attention mechanism

350 papers

Explore in graph

Also known as

MHSA SACC CSA SA SAM

Co-occurring keywords

transformer architecture (1555) vision transformer (1091) attention mechanism (3975) transformer model (1988) neural network (6616) representation learning (6174) text classification (6776) graph neural network (3945) neural network optimization (1293) computational efficiency (358)

Papers

Detect Profane Language in Streaming Services to Protect Young Audiences ACL 2021
Sequence-to-Sequence Learning for Deep Gaussian Process Based Speech Synthesis Using Self-Attention GP Layer INTERSPEECH 2021
Do Long-Range Language Models Actually Use Long-Range Context? EMNLP 2021
PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021
Detect Profane Language in Streaming Services to Protect Young Audiences IJCNLP 2021
Intriguing Properties of Vision Transformers NIPS 2021
Deep Contextual Clinical Prediction with Reverse Distillation AAAI 2021
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting AAAI 2021
GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction AAAI 2021
More Identifiable yet Equally Performant Transformers for Text Classification IJCNLP 2021
Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-Based Multimodal Fusion INTERSPEECH 2021
Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis ACL 2021
Self-Attention Channel Combinator Frontend for End-to-End Multichannel Far-Field Speech Recognition INTERSPEECH 2021
Pose Recognition With Cascade Transformers CVPR 2021
Speech Emotion Recognition Based on Attention Weight Correction Using Word-Level Confidence Measure INTERSPEECH 2021
SRIB-LEAP Submission to Far-Field Multi-Channel Speech Enhancement Challenge for Video Conferencing INTERSPEECH 2021
Time-aware Graph Neural Network for Entity Alignment between Temporal Knowledge Graphs EMNLP 2021
Recurrent Attention for Neural Machine Translation EMNLP 2021
CNNBiF: CNN-based Bigram Features for Named Entity Recognition EMNLP 2021
Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding INTERSPEECH 2021
Exploring Forensic Dental Identification with Deep Learning NIPS 2021
Blending Anti-Aliasing into Vision Transformer NIPS 2021
CATs: Cost Aggregation Transformers for Visual Correspondence NIPS 2021
Shifted Chunk Transformer for Spatio-Temporal Representational Learning NIPS 2021
ResT: An Efficient Transformer for Visual Recognition NIPS 2021