conftrace_

multi-head attention

172 papers

Explore in graph

Also known as

MHA

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) neural network (6616) neural machine translation (2310) text classification (6793) machine translation (2499) representation learning (6206) transformer model (1996) neural network optimization (1293) mixture of expert (640)

Papers

Modeling Intra-Relation in Math Word Problems with Different Functional Multi-Head Attentions ACL 2019
Detecting and Extracting of Adverse Drug Reaction Mentioning Tweets with Multi-Head Self Attention ACL 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned ACL 2019
Divisive Language and Propaganda Detection using Multi-head Attention Transformers with Deep Learning BERT-based Language Models for Binary Classification EMNLP 2019
Tensorized Self-Attention: Efficiently Modeling Pairwise and Global Dependencies Together NAACL 2019
Dual Attention Networks for Visual Reference Resolution in Visual Dialog EMNLP 2019
Area Attention ICML 2019
Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations EMNLP 2019
Information Aggregation for Multi-Head Attention with Routing-by-Agreement NAACL 2019
Relation Extraction among Multiple Entities Using a Dual Pointer Network with a Multi-Head Attention Mechanism EMNLP 2019
A Multi-Task Learning Approach for Answer Selection: A Study and a Chinese Law Dataset AAAI 2019
Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations IJCNLP 2019
Multi-Granularity Self-Attention for Neural Machine Translation EMNLP 2019
MrMep: Joint Extraction of Multiple Relations and Multiple Entity Pairs Based on Triplet Attention CONLL 2019
Relational recurrent neural networks NIPS 2018
Get The Point of My Utterance! Learning Towards Effective Responses with Multi-Head Attention Mechanism IJCAI 2018
On The Alignment Problem In Multi-Head Attention-Based Neural Machine Translation EMNLP 2018
Self-Attention: A Better Building Block for Sentiment Analysis Neural Network Classifiers EMNLP 2018
Learning Universal Sentence Representations with Mean-Max Attention Autoencoder EMNLP 2018
Enhancing Sentence Embedding with Generalized Pooling COLING 2018
Multi-Head Decoder for End-to-End Speech Recognition INTERSPEECH 2018
Multi-Head Attention with Disagreement Regularization EMNLP 2018