attention mechanism

3975 papers

Explore in graph

Also known as

AGM GPA AM MHSA QKV DAM ATTENTION MHA IMA

Co-occurring keywords

neural network (6616) convolutional neural network (4216) multimodal learning (4622) transformer architecture (1555) graph neural network (3945) recurrent neural network (1790) text classification (6776) representation learning (6174) neural machine translation (2310) large language model (12755)

Papers

STEMFold: Stochastic temporal manifold for multi-agent interactions in the presence of hidden agents L4DC 2024

Dual Expert Distillation Network for Generalized Zero-Shot Learning IJCAI 2024

Learning from Highly Sparse Spatio-temporal Data NIPS 2024

Multi-Attention Based Visual-Semantic Interaction for Few-Shot Learning IJCAI 2024

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions EMNLP 2024

Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers CVPR 2024

All You Need is Attention: Lightweight Attention-based Data Augmentation for Text Classification EMNLP 2024

Finding Educationally Supportive Contexts for Vocabulary Learning with Attention-Based Models COLING 2024

Word-Aware Modality Stimulation for Multimodal Fusion COLING 2024

Unraveling the Gradient Descent Dynamics of Transformers NIPS 2024

DAMRO: Dive into the Attention Mechanism of LVLM to Reduce Object Hallucination EMNLP 2024

Chain and Causal Attention for Efficient Entity Tracking EMNLP 2024

Understanding Transformer Reasoning Capabilities via Graph Algorithms NIPS 2024

GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping NIPS 2024

Improving Backchannel Prediction Leveraging Sequential and Attentive Context Awareness EACL 2024

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024

Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models NIPS 2024

FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision NIPS 2024

Training-Free Open-Ended Object Detection and Segmentation via Attention as Prompts NIPS 2024

IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact ACL 2024

Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery NIPS 2024

ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models NIPS 2024

ParallelEdits: Efficient Multi-Aspect Text-Driven Image Editing with Attention Grouping NIPS 2024

Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning ACL 2024