conftrace_

multi-head attention

172 papers

Explore in graph

Also known as

MHA

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) neural network (6616) neural machine translation (2310) text classification (6793) machine translation (2499) representation learning (6206) transformer model (1996) neural network optimization (1293) mixture of expert (640)

Papers

Exploring Self-Distillation Based Relational Reasoning Training for Document-Level Relation Extraction AAAI 2023
AShapeFormer: Semantics-Guided Object-Level Active Shape Encoding for 3D Object Detection via Transformers CVPR 2023
GRAVO: Learning to Generate Relevant Audio from Visual Features with Noisy Online Videos INTERSPEECH 2023
3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding EMNLP 2023
Nested Deformable Multi-Head Attention for Facial Image Inpainting WACV 2023
Mixture of Attention Heads: Selecting Attention Heads Per Token EMNLP 2022
Informative Language Representation Learning for Massively Multilingual Neural Machine Translation COLING 2022
Improving Visual Speech Enhancement Network by Learning Audio-visual Affinity with Multi-head Attention INTERSPEECH 2022
Neural Window Fully-Connected CRFs for Monocular Depth Estimation CVPR 2022
Alleviating the Inequality of Attention Heads for Neural Machine Translation COLING 2022
Gaussian Multi-head Attention for Simultaneous Machine Translation ACL 2022
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading AAAI 2022
A study on constraining Connectionist Temporal Classification for temporal audio alignment INTERSPEECH 2022
BM-NAS: Bilevel Multimodal Neural Architecture Search AAAI 2022
CGIM: A Cycle Guided Interactive Learning Model for Consistency Identification in Task-oriented Dialogue COLING 2022
Doctor Recommendation in Online Health Forums via Expertise Learning ACL 2022
LITE: Intent-based Task Representation Learning Using Weak Supervision NAACL 2022
Recurrent multi-head attention fusion network for combining audio and text for speech emotion recognition INTERSPEECH 2022
Measuring the Mixing of Contextual Information in the Transformer EMNLP 2022
Improving Transformers with Probabilistic Attention Keys ICML 2022
Hero-Gang Neural Model For Named Entity Recognition NAACL 2022
Detecting Incongruent News Articles Using Multi-head Attention Dual Summarization AACL 2022
AME: Attention and Memory Enhancement in Hyper-Parameter Optimization CVPR 2022
Deeply Tensor Compressed Transformers for End-to-End Object Detection AAAI 2022
Squeezeformer: An Efficient Transformer for Automatic Speech Recognition NIPS 2022