← Keywords

self-attention mechanism

350 papers

Explore in graph

Also known as

MHSA SACC CSA SA SAM

Co-occurring keywords

transformer architecture (1555) vision transformer (1091) attention mechanism (3975) transformer model (1988) neural network (6616) representation learning (6174) text classification (6776) graph neural network (3945) neural network optimization (1293) computational efficiency (358)

Papers

Lightweight Vision Transformer with Bidirectional Interaction NIPS 2023
Singularformer: Learning to Decompose Self-Attention to Linearize the Complexity of Transformer IJCAI 2023
OutfitTransformer: Learning Outfit Representations for Fashion Recommendation WACV 2023
SMARTformer: Semi-Autoregressive Transformer with Efficient Integrated Window Attention for Long Time Series Forecasting IJCAI 2023
Dynamic Aggregated Network for Gait Recognition CVPR 2023
Efficient Frequency Domain-Based Transformers for High-Quality Image Deblurring CVPR 2023
AsT: An Asymmetric-Sensitive Transformer for Osteonecrosis of the Femoral Head Detection (Student Abstract) AAAI 2023
Recurrent Attention Networks for Long-text Modeling ACL 2023
Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling ACL 2023
Pose-Oriented Transformer with Uncertainty-Guided Refinement for 2D-to-3D Human Pose Estimation AAAI 2023
Fine-grained Artificial Neurons in Audio-transformers for Disentangling Neural Auditory Encoding ACL 2023
ViBid: Linear Vision Transformer with Bidirectional Normalization UAI 2023
Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Method AAAI 2023
Fine-Grained Position Helps Memorizing More, a Novel Music Compound Transformer Model with Feature Interaction Fusion AAAI 2023
The Role of Global and Local Context in Named Entity Recognition ACL 2023
Mitigating Over-smoothing in Transformers via Regularized Nonlocal Functionals NIPS 2023
Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer NIPS 2023
Analyzing Vision Transformers for Image Classification in Class Embedding Space NIPS 2023
SwinLSTM: Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTM ICCV 2023
Dynamic Structured Neural Topic Model with Self-Attention Mechanism ACL 2023
Transformers from an Optimization Perspective NIPS 2022
Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse NIPS 2022
Fast Vision Transformers with HiLo Attention NIPS 2022
Multiview Human Body Reconstruction from Uncalibrated Cameras NIPS 2022
SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation NIPS 2022