attention mechanism

3975 papers

Explore in graph

Also known as

AGM GPA AM MHSA QKV DAM ATTENTION MHA IMA

Co-occurring keywords

neural network (6616) convolutional neural network (4216) multimodal learning (4622) transformer architecture (1555) graph neural network (3945) recurrent neural network (1790) text classification (6776) representation learning (6174) neural machine translation (2310) large language model (12755)

Papers

BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basis NIPS 2023

Neural Lad: A Neural Latent Dynamics Framework for Times Series Modeling NIPS 2023

MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining NIPS 2023

Good Helper Is around You: Attention-Driven Masked Image Modeling AAAI 2023

Unlimiformer: Long-Range Transformers with Unlimited Length Input NIPS 2023

Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time NIPS 2023

Influence Diagnostics under Self-concordance AISTATS 2023

Zero-Shot Slot Filling with Slot-Prefix Prompting and Attention Relationship Descriptor AAAI 2023

TADI: Topic-aware Attention and Powerful Dual-encoder Interaction for Recall in News Recommendation EMNLP 2023

VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers EMNLP 2023

Focus on the Core: Efficient Attention via Pruned Token Compression for Document Classification EMNLP 2023

Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attention EMNLP 2023

Focused Transformer: Contrastive Training for Context Scaling NIPS 2023

OctFormer: Efficient Octree-Based Transformer for Point Cloud Compression with Local Enhancement AAAI 2023

HFMRE: Constructing Huffman Tree in Bags to Find Excellent Instances for Distantly Supervised Relation Extraction EMNLP 2023

MISCA: A Joint Model for Multiple Intent Detection and Slot Filling with Intent-Slot Co-Attention EMNLP 2023

Addressing the Length Bias Challenge in Document-Level Neural Machine Translation EMNLP 2023

Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention EMNLP 2023

Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention EMNLP 2023

EARA: Improving Biomedical Semantic Textual Similarity with Entity-Aligned Attention and Retrieval Augmentation EMNLP 2023

DemaFormer: Damped Exponential Moving Average Transformer with Energy-Based Modeling for Temporal Language Grounding EMNLP 2023

PsyAttention: Psychological Attention Model for Personality Detection EMNLP 2023

Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer EMNLP 2023

Enhancing Neural Machine Translation with Semantic Units EMNLP 2023

Multi-View Frequency-Attention Alternative to CNN Frontends for Automatic Speech Recognition INTERSPEECH 2023