attention mechanism

3975 papers

Explore in graph

Also known as

AGM GPA AM MHSA QKV DAM ATTENTION MHA IMA

Co-occurring keywords

neural network (6616) convolutional neural network (4216) multimodal learning (4622) transformer architecture (1555) graph neural network (3945) recurrent neural network (1790) text classification (6776) representation learning (6174) neural machine translation (2310) large language model (12755)

Papers

Repairing Catastrophic-Neglect in Text-to-Image Diffusion Models via Attention-Guided Feature Enhancement EMNLP 2024

STEMFold: Stochastic temporal manifold for multi-agent interactions in the presence of hidden agents L4DC 2024

SEAVER: Attention Reallocation for Mitigating Distractions in Language Models for Conditional Semantic Textual Similarity Measurement EMNLP 2024

IMO: Greedy Layer-Wise Sparse Representation Learning for Out-of-Distribution Text Classification with Pre-trained Models ACL 2024

Don’t Shoot The Breeze: Topic Continuity Model Using Nonlinear Naive Bayes With Attention EMNLP 2024

Tending Towards Stability: Convergence Challenges in Small Language Models EMNLP 2024

All You Need is Attention: Lightweight Attention-based Data Augmentation for Text Classification EMNLP 2024

External Knowledge-Driven Argument Mining: Leveraging Attention-Enhanced Multi-Network Models EMNLP 2024

Scaling Laws for Linear Complexity Language Models EMNLP 2024

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions EMNLP 2024

LMEME at SemEval-2024 Task 4: Teacher Student Fusion - Integrating CLIP with LLMs for Enhanced Persuasion Detection SEMEVAL 2024

Learning locally interacting discrete dynamical systems: Towards data-efficient and scalable prediction L4DC 2024

Gradformer: Graph Transformer with Exponential Decay IJCAI 2024

Learning Random Noise Salient Feature Fusion Siamese Network for Low-Resolution Object Tracking (Student Abstract) AAAI 2024

Fast and Knowledge-Free Deep Learning for General Game Playing (Student Abstract) AAAI 2024

Bridging the Divide: Reconsidering Softmax and Linear Attention NIPS 2024

A Simple and Effective L_2 Norm-Based Strategy for KV Cache Compression EMNLP 2024

SaSR-Net: Source-Aware Semantic Representation Network for Enhancing Audio-Visual Question Answering EMNLP 2024

Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract) AAAI 2024

The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers (Student Abstract) AAAI 2024

IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact ACL 2024

Attention-Based Models for Snow-Water Equivalent Prediction AAAI 2024

iTrendRNN: An Interpretable Trend-Aware RNN for Meteorological Spatiotemporal Prediction AAAI 2024

Identifying Semantic Induction Heads to Understand In-Context Learning ACL 2024