← Keywords

attention mechanism

3975 papers

Explore in graph

Also known as

AGM GPA AM MHSA QKV DAM ATTENTION MHA IMA

Co-occurring keywords

neural network (6616) convolutional neural network (4216) multimodal learning (4622) transformer architecture (1555) graph neural network (3945) recurrent neural network (1790) text classification (6776) representation learning (6174) neural machine translation (2310) large language model (12755)

Papers

A Simple and Effective L_2 Norm-Based Strategy for KV Cache Compression EMNLP 2024
Scaling Laws for Linear Complexity Language Models EMNLP 2024
Don’t Shoot The Breeze: Topic Continuity Model Using Nonlinear Naive Bayes With Attention EMNLP 2024
Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding EMNLP 2024
MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesis CVPR 2024
Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speed CVPR 2024
ContextSeg: Sketch Semantic Segmentation by Querying the Context with Attention CVPR 2024
Chain and Causal Attention for Efficient Entity Tracking EMNLP 2024
Dynamic Cues-Assisted Transformer for Robust Point Cloud Registration CVPR 2024
FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation CVPR 2024
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NIPS 2024
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024
All You Need is Attention: Lightweight Attention-based Data Augmentation for Text Classification EMNLP 2024
VerbaNexAI Lab at SemEval-2024 Task 1: A Multilayer Artificial Intelligence Model for Semantic Relationship Detection SEMEVAL 2024
Gradformer: Graph Transformer with Exponential Decay IJCAI 2024
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact ACL 2024
Understanding Transformer Reasoning Capabilities via Graph Algorithms NIPS 2024
Uncovering the Handwritten Text in the Margins: End-to-end Handwritten Text Detection and Recognition EACL 2024
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping NIPS 2024
HydraViT: Stacking Heads for a Scalable ViT NIPS 2024
Training-Free Open-Ended Object Detection and Segmentation via Attention as Prompts NIPS 2024
Unraveling the Gradient Descent Dynamics of Transformers NIPS 2024
ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models NIPS 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
DRIP: Unleashing Diffusion Priors for Joint Foreground and Alpha Prediction in Image Matting NIPS 2024