conftrace_

multi-head attention

172 papers

Explore in graph

Also known as

MHA

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) neural network (6616) neural machine translation (2310) text classification (6793) machine translation (2499) representation learning (6206) transformer model (1996) neural network optimization (1293) mixture of expert (640)

Papers

Deeply Tensor Compressed Transformers for End-to-End Object Detection AAAI 2022
Doctor Recommendation in Online Health Forums via Expertise Learning ACL 2022
Measuring the Mixing of Contextual Information in the Transformer EMNLP 2022
Improving Transformer with an Admixture of Attention Heads NIPS 2022
Learning to Combine Per-Example Solutions for Neural Program Synthesis NIPS 2021
Reformulating HOI Detection As Adaptive Set Prediction CVPR 2021
A Health-friendly Speaker Verification System Supporting Mask Wearing AAAI 2021
Cascaded Head-colliding Attention ACL 2021
Neural Machine Translation with Synchronous Latent Phrase Structure ACL 2021
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy EMNLP 2021
Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks ACL 2021
EL-Attention: Memory Efficient Lossless Attention for Generation ICML 2021
Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding INTERSPEECH 2021
Stochastic Attention Head Removal: A Simple and Effective Method for Improving Transformer Based ASR Models INTERSPEECH 2021
Detect Profane Language in Streaming Services to Protect Young Audiences ACL 2021
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling NIPS 2021
TA-MAMC at SemEval-2021 Task 4: Task-adaptive Pretraining and Multi-head Attention for Abstract Meaning Reading Comprehension IJCNLP 2021
A Supervised Multi-Head Self-Attention Network for Nested Named Entity Recognition AAAI 2021
XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning ACL 2021
Noise Robust Acoustic Modeling for Single-Channel Speech Recognition Based on a Stream-Wise Transformer Architecture INTERSPEECH 2021
Cascaded Head-colliding Attention IJCNLP 2021
Incorporating Circumstances into Narrative Event Prediction EMNLP 2021
Multi-Attentive Detection of the Spider Monkey Whinny in the (Actual) Wild INTERSPEECH 2021
Enlivening Redundant Heads in Multi-head Self-attention for Machine Translation EMNLP 2021
Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks IJCNLP 2021