← Keywords

self-attention mechanism

350 papers

Explore in graph

Also known as

MHSA SACC CSA SA SAM

Co-occurring keywords

transformer architecture (1555) vision transformer (1091) attention mechanism (3975) transformer model (1988) neural network (6616) representation learning (6174) text classification (6776) graph neural network (3945) neural network optimization (1293) computational efficiency (358)

Papers

LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention EMNLP 2020
Cascaded Semantic and Positional Self-Attention Network for Document Classification EMNLP 2020
Improve Transformer Models with Better Relative Position Embeddings EMNLP 2020
Do We Really Need That Many Parameters In Transformer For Extractive Summarization? Discourse Can Help ! EMNLP 2020
NUIG: Multitasking Self-attention based approach to SigTyp 2020 Shared Task EMNLP 2020
Adabot: Fault-Tolerant Java Decompiler (Student Abstract) AAAI 2020
An Element-aware Multi-representation Model for Law Article Prediction EMNLP 2020
Self-and-Mixed Attention Decoder with Deep Acoustic Structure for Transformer-Based LVCSR INTERSPEECH 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding EMNLP 2020
Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads AACL 2020
Energy-based Self-attentive Learning of Abstractive Communities for Spoken Language Understanding AACL 2020
NLFIIT at SemEval-2020 Task 11: Neural Network Architectures for Detection of Propaganda Techniques in News Articles SEMEVAL 2020
Real-Time Panoptic Segmentation From Dense Detections CVPR 2020
End-to-End Neural Transformer Based Spoken Language Understanding INTERSPEECH 2020
SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection NIPS 2020
End-to-End Speech Emotion Recognition Combined with Acoustic-to-Word ASR Model INTERSPEECH 2020
A Transformer-based Approach for Source Code Summarization ACL 2020
CNRL at SemEval-2020 Task 5: Modelling Causal Reasoning in Language with Multi-Head Self-Attention Weights Based Counterfactual Detection SEMEVAL 2020
Pseudo-Bidirectional Decoding for Local Sequence Transduction EMNLP 2020
On the Ability and Limitations of Transformers to Recognize Formal Languages EMNLP 2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution NIPS 2020
CopyBERT: A Unified Approach to Question Generation with Self-Attention ACL 2020
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers ACL 2020
Inflated Episodic Memory With Region Self-Attention for Long-Tailed Visual Recognition CVPR 2020
Conversational Emotion Recognition Using Self-Attention Mechanisms and Graph Neural Networks INTERSPEECH 2020