conftrace_

multi-head attention

172 papers

Explore in graph

Also known as

MHA

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) neural network (6616) neural machine translation (2310) text classification (6793) machine translation (2499) representation learning (6206) transformer model (1996) neural network optimization (1293) mixture of expert (640)

Papers

Interpretable Operational Risk Classification with Semi-Supervised Variational Autoencoder ACL 2020
Neural Multi-task Text Normalization and Sanitization with Pointer-Generator ACL 2020
Singing Voice Extraction with Attention-Based Spectrograms Fusion INTERSPEECH 2020
Acoustic Scene Analysis with Multi-Head Attention Networks INTERSPEECH 2020
Tencent submission for WMT20 Quality Estimation Shared Task EMNLP 2020
Pheonix at SemEval-2020 Task 5: Masking the Labels Lubricates Models for Sequence Labeling SEMEVAL 2020
A Mixture of h - 1 Heads is Better than h Heads ACL 2020
Roles and Utilization of Attention Heads in Transformer-based Neural Language Models ACL 2020
Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detection EMNLP 2020
Transform and Tell: Entity-Aware News Image Captioning CVPR 2020
Efficient Inference For Neural Machine Translation EMNLP 2020
Scheduled DropHead: A Regularization Method for Transformer Models EMNLP 2020
Multi-Unit Transformers for Neural Machine Translation EMNLP 2020
Multi-Encoder-Decoder Transformer for Code-Switching Speech Recognition INTERSPEECH 2020
Acoustic Scene Classification Using Audio Tagging INTERSPEECH 2020
Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation EMNLP 2020
MHSAN: Multi-Head Self-Attention Network for Visual Semantic Embedding WACV 2020
Vision-Dialog Navigation by Exploring Cross-Modal Memory CVPR 2020
Streaming Keyword Spotting on Mobile Devices INTERSPEECH 2020
Competence-Level Prediction and Resume & Job Description Matching Using Context-Aware Transformer Models EMNLP 2020
Cross-Media Keyphrase Prediction: A Unified Framework with Multi-Modality Multi-Head Attention and Image Wordings EMNLP 2020
Working Memory Graphs ICML 2020
Seeing Both the Forest and the Trees: Multi-head Attention for Joint Classification on Different Compositional Levels COLING 2020
Pheonix at SemEval-2020 Task 5: Masking the Labels Lubricates Models for Sequence Labeling COLING 2020
Convolutional Self-Attention Networks NAACL 2019