self-attention mechanism

Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer Interspeech 2024 EFormer: Enhanced Transformer towards Semantic-Contour Features of Foreground for Portraits Matting CVPR 2024 Enhancing Self-Attention via Knowledge Fusion: Deriving Sentiment Lexical Attention from Semantic-Polarity Scores NAACL 2024 Fully-Automatic Reflection Removal for 360-Degree Images WACV 2024 Gramformer: Learning Crowd Counting via Graph-Modulated Transformer AAAI 2024 Graph Convolutions Enrich the Self-Attention in Transformers! NeurIPS 2024 Hierarchical Topic Modeling via Contrastive Learning and Hyperbolic Embedding COLING 2024 HomoFormer: Homogenized Transformer for Image Shadow Removal CVPR 2024 Leverage the Explainability of Transformer Models to Improve the DNA 5-Methylcytosine Identification (Student Abstract) AAAI 2024 Locally Biased Transformers Better Align with Human Reading Times ACL 2024 Loki: Low-rank Keys for Efficient Sparse Attention NeurIPS 2024 MetaJND: A Meta-Learning Approach for Just Noticeable Difference Estimation IJCAI 2024 MLP Can Be A Good Transformer Learner CVPR 2024 MSGNet: Learning Multi-Scale Inter-series Correlations for Multivariate Time Series Forecasting AAAI 2024 Proxyformer: Nyström-Based Linear Transformer with Trainable Proxy Tokens AAAI 2024 QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NeurIPS 2024 Rethinking the Development of Large Language Models from the Causal Perspective: A Legal Text Prediction Case Study AAAI 2024 Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysis NeurIPS 2024 SACNN: Self Attention-based Convolutional Neural Network for Fraudulent Behaviour Detection in Sports IJCAI 2024 SADI: Similarity-Aware Diffusion Model-Based Imputation for Incomplete Temporal EHR Data AISTATS 2024 SDformer: Transformer with Spectral Filter and Dynamic Attention for Multivariate Time Series Long-term Forecasting IJCAI 2024 Sharing Key Semantics in Transformer Makes Efficient Image Restoration NeurIPS 2024 SiT: Symmetry-invariant Transformers for Generalisation in Reinforcement Learning ICML 2024 Spatial Transform Decoupling for Oriented Object Detection AAAI 2024 SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks CVPR 2024