conftrace_

multi-head attention

181 papers

Explore in graph

Also known as

MHA

Co-occurring keywords · papers mentioning both

attention mechanism (44) transformer architecture (28) neural network (17) neural machine translation (12) machine translation (11) text classification (11) representation learning (10) neural network optimization (8) multi-head self-attention (7) knowledge distillation (7)

Papers

Learning Universal Sentence Representations with Mean-Max Attention Autoencoder EMNLP 2018 Multi-Head Attention with Disagreement Regularization EMNLP 2018 Multi-Head Decoder for End-to-End Speech Recognition Interspeech 2018 On The Alignment Problem In Multi-Head Attention-Based Neural Machine Translation EMNLP 2018 Relational recurrent neural networks NeurIPS 2018 Self-Attention: A Better Building Block for Sentiment Analysis Neural Network Classifiers EMNLP 2018