conftrace_

multi-head attention

172 papers

Explore in graph

Also known as

MHA

Co-occurring keywords

attention mechanism (4001) transformer architecture (1560) neural network (6616) neural machine translation (2310) text classification (6793) machine translation (2499) representation learning (6206) transformer model (1996) neural network optimization (1293) mixture of expert (640)

Papers

The Strong Lottery Ticket Hypothesis for Multi-Head Attention Mechanisms AAAI 2026
LightGazeNet: A Lightweight GNN-based Architecture for Gaze Estimation WACV 2026
CoFact: Dynamic Coordination of Attention Heads for Improving Factual Consistency in LLMs AAAI 2026
Redundancy-optimized Multi-head Attention Networks for Multi-view Multi-label Feature Selection AAAI 2026
EventWeave: A Dynamic Framework for Capturing Core and Supporting Events in Dialogue Systems ACL 2026
SCOPE: Boosting LLM Efficiency with Scoped Position Encoding ACL 2026
EdgeFormer: Latency-Aware Collaborative Multi-Head Attention of Transformer Inference in Edge Networks ACL 2026
Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lens CVPR 2025
MA-RAG: Automating Role Engineering for RESTful APIs with Multi-Head Attention and Retrieval-Augmented Generation IJCAI 2025
Devil is in the Uniformity: Exploring Diverse Learners within Transformer for Image Restoration ICCV 2025
HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolution CVPR 2025
DIH-CLIP: Unleashing the Diversity of Multi-Head Self-Attention for Training-Free Open-Vocabulary Semantic Segmentation ICCV 2025
INFOTEC-NLP at SemEval-2025 Task 11: A Case Study on Transformer-Based Models and Bag of Words ACL 2025
SWAM: Adaptive Sliding Window and Memory-Augmented Attention Model for Rumor Detection EMNLP 2025
Layer Duplication in LLMs EMNLP 2025
MossNet: Mixture of State-Space Experts is a Multi-Head Attention AACL 2025
MossNet: Mixture of State-Space Experts is a Multi-Head Attention IJCNLP 2025
When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models EMNLP 2025
Length Representations in Large Language Models EMNLP 2025
Incepto@DravidianLangTech 2025: Detecting Abusive Tamil and Malayalam Text Targeting Women on YouTube NAACL 2025
INFOTEC-NLP at SemEval-2025 Task 11: A Case Study on Transformer-Based Models and Bag of Words SEMEVAL 2025
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs EMNLP 2024
Mean-Shift Feature Transformer CVPR 2024
How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers NIPS 2024
LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024