self-attention mechanism

350 papers

Explore in graph

Also known as

MHSA SACC CSA SA SAM

Co-occurring keywords

transformer architecture (1555) vision transformer (1091) attention mechanism (3975) transformer model (1988) neural network (6616) representation learning (6174) text classification (6776) graph neural network (3945) neural network optimization (1293) computational efficiency (358)

Papers

Uncovering Syllable Constituents in the Self-Attention-Based Speech Representations of Whisper EMNLP 2024

Proxyformer: Nyström-Based Linear Transformer with Trainable Proxy Tokens AAAI 2024

QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NIPS 2024

An Attentive Inductive Bias for Sequential Recommendation beyond the Self-Attention AAAI 2024

What Makes Language Models Good-enough? ACL 2024

HomoFormer: Homogenized Transformer for Image Shadow Removal CVPR 2024

Dissecting Query-Key Interaction in Vision Transformers NIPS 2024

Enhancing Self-Attention via Knowledge Fusion: Deriving Sentiment Lexical Attention from Semantic-Polarity Scores NAACL 2024

MSGNet: Learning Multi-Scale Inter-series Correlations for Multivariate Time Series Forecasting AAAI 2024

SADI: Similarity-Aware Diffusion Model-Based Imputation for Incomplete Temporal EHR Data AISTATS 2024

TCNet: Continuous Sign Language Recognition from Trajectories and Correlated Regions AAAI 2024

Leverage the Explainability of Transformer Models to Improve the DNA 5-Methylcytosine Identification (Student Abstract) AAAI 2024

Target Focused Shallow Transformer Framework for Efficient Visual Tracking AAAI 2024

A Neural Architecture Predictor based on GNN-Enhanced Transformer AISTATS 2024

Rethinking the Development of Large Language Models from the Causal Perspective: A Legal Text Prediction Case Study AAAI 2024

Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer INTERSPEECH 2024

SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks CVPR 2024

Graph Convolutions Enrich the Self-Attention in Transformers! NIPS 2024

EFormer: Enhanced Transformer towards Semantic-Contour Features of Foreground for Portraits Matting CVPR 2024

MetaJND: A Meta-Learning Approach for Just Noticeable Difference Estimation IJCAI 2024

Detecting Ambiguous Utterances in an Intelligent Assistant EMNLP 2024

Towards Automated Movie Trailer Generation CVPR 2024

Sharing Key Semantics in Transformer Makes Efficient Image Restoration NIPS 2024

Dual-Window Multiscale Transformer for Hyperspectral Snapshot Compressive Imaging AAAI 2024

MLP Can Be A Good Transformer Learner CVPR 2024