Skip to content
conftrace_

multi-head attention

181 papers

MHA

Papers

Exploring Self-Distillation Based Relational Reasoning Training for Document-Level Relation Extraction AAAI 2023 Finding the Pillars of Strength for Multi-Head Attention ACL 2023 GRAVO: Learning to Generate Relevant Audio from Visual Features with Noisy Online Videos Interspeech 2023 Interpreting and Exploiting Functional Specialization in Multi-Head Attention under Multi-task Learning EMNLP 2023 Learning to Jointly Share and Prune Weights for Grounding Based Vision and Language Models ICLR 2023 Mao-Zedong at SemEval-2023 Task 4: Label Represention Multi-Head Attention Model with Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification SemEval 2023 Monocular Scene Reconstruction with 3D SDF Transformers ICLR 2023 Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling ACL 2023 Multi-Head State Space Model for Speech Recognition Interspeech 2023 Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition Interspeech 2023 Nested Deformable Multi-Head Attention for Facial Image Inpainting WACV 2023 On the Expressivity Role of LayerNorm in Transformers’ Attention ACL 2023 Part Aware Contrastive Learning for Self-Supervised Action Recognition IJCAI 2023 Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention EMNLP 2023 RADIANT: Better rPPG Estimation Using Signal Embeddings and Transformer WACV 2023 Reinforced Target-driven Conversational Promotion EMNLP 2023 SEF-Net: Speaker Embedding Free Target Speaker Extraction Network Interspeech 2023 Singularformer: Learning to Decompose Self-Attention to Linearize the Complexity of Transformer IJCAI 2023 Transforming Visual Scene Graphs to Image Captions ACL 2023 What can a Single Attention Layer Learn? A Study Through the Random Features Lens NeurIPS 2023 Alleviating the Inequality of Attention Heads for Neural Machine Translation COLING 2022 AME: Attention and Memory Enhancement in Hyper-Parameter Optimization CVPR 2022 A study on constraining Connectionist Temporal Classification for temporal audio alignment Interspeech 2022 A Transformer Architecture for the Prediction of Cognate Reflexes NAACL 2022 BM-NAS: Bilevel Multimodal Neural Architecture Search AAAI 2022