multi-head attention

SWAM: Adaptive Sliding Window and Memory-Augmented Attention Model for Rumor Detection EMNLP 2025 Towards Fusion of Neural Audio Codec-based Representations with Spectral for Heart Murmur Classification via Bandit-based Cross-Attention Mechanism Interspeech 2025 Understanding and Mitigating Hallucination in Large Vision-Language Models via Modular Attribution and Intervention ICLR 2025 When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models EMNLP 2025 A Theoretical Understanding of Self-Correction through In-context Alignment NeurIPS 2024 How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers NeurIPS 2024 How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression NeurIPS 2024 Improving Transformers with Dynamically Composable Multi-Head Attention ICML 2024 Inferring Iterated Function Systems Approximately from Fractal Images IJCAI 2024 LingWav2Vec2: Linguistic-augmented wav2vec 2.0 for Vietnamese Mispronunciation Detection Interspeech 2024 LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024 Masked Autoencoders with Multi-Window Local-Global Attention Are Better Audio Learners ICLR 2024 Mean-Shift Feature Transformer CVPR 2024 Memorization Capacity of Multi-Head Attention in Transformers ICLR 2024 More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs EMNLP 2024 No Head Left Behind – Multi-Head Alignment Distillation for Transformers AAAI 2024 PartialFormer: Modeling Part Instead of Whole for Machine Translation ACL 2024 PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networks ICLR 2024 Training Dynamics of Multi-Head Softmax Attention for In-Context Learning: Emergence, Convergence, and Optimality (extended abstract) COLT 2024 3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding EMNLP 2023 A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models EMNLP 2023 AShapeFormer: Semantics-Guided Object-Level Active Shape Encoding for 3D Object Detection via Transformers CVPR 2023 Attention Gate Between Capsules in Fully Capsule-Network Speech Recognition Interspeech 2023 Calibrating Transformers via Sparse Gaussian Processes ICLR 2023 End-to-end clinical temporal information extraction with multi-head attention ACL 2023