attention mechanism

3975 papers

Explore in graph

Also known as

AGM GPA AM MHSA QKV DAM ATTENTION MHA IMA

Co-occurring keywords

neural network (6616) convolutional neural network (4216) multimodal learning (4622) transformer architecture (1555) graph neural network (3945) recurrent neural network (1790) text classification (6776) representation learning (6174) neural machine translation (2310) large language model (12755)

Papers

Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets WACV 2023

TRAMS: Training-free Memory Selection for Long-range Language Modeling EMNLP 2023

Solving High-Dimensional PDEs with Latent Spectral Models ICML 2023

GNOT: A General Neural Operator Transformer for Operator Learning ICML 2023

Multi-Domain Dialogue State Tracking with Disentangled Domain-Slot Attention ACL 2023

Randomized Positional Encodings Boost Length Generalization of Transformers ACL 2023

CTC Alignments Improve Autoregressive Translation EACL 2023

DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction EACL 2023

Semi-supervised Credit Card Fraud Detection via Attribute-Driven Graph Representation AAAI 2023

KDEformer: Accelerating Transformers via Kernel Density Estimation ICML 2023

Graph Inductive Biases in Transformers without Message Passing ICML 2023

Sequential Graph Attention Learning for Predicting Dynamic Stock Trends (Student Abstract) AAAI 2023

Less Is More Important: An Attention Module Guided by Probability Density Function for Convolutional Neural Networks AAAI 2023

FAA: Fine-grained Attention Alignment for Cascade Document Ranking ACL 2023

JobXMLC: EXtreme Multi-Label Classification of Job Skills with Graph Neural Networks EACL 2023

Selector-Enhancer: Learning Dynamic Selection of Local and Non-local Attention Operation for Speech Enhancement AAAI 2023

Long Legal Article Question Answering via Cascaded Key Segment Learning (Student Abstract) AAAI 2023

Debunking Biases in Attention ACL 2023

Generative Knowledge Selection for Knowledge-Grounded Dialogues EACL 2023

HuaSLIM: Human Attention Motivated Shortcut Learning Identification and Mitigation for Large Language models ACL 2023

Zero-Shot Slot Filling with Slot-Prefix Prompting and Attention Relationship Descriptor AAAI 2023

Neural Language Model Based Attentive Term Dependence Model for Verbose Query (Student Abstract) AAAI 2023

Focus Your Attention when Few-Shot Classification NIPS 2023

Recurrent Structure Attention Guidance for Depth Super-resolution AAAI 2023

BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basis NIPS 2023