Attention Mechanism

Bi-Directional Object-Context Prioritization Learning for Saliency Ranking CVPR 2022 DisARM: Displacement Aware Relation Module for 3D Detection CVPR 2022 Fast Vision Transformers with HiLo Attention NeurIPS 2022 FourierFormer: Transformer Meets Generalized Fourier Integral Theorem NeurIPS 2022 How Attentive are Graph Attention Networks? ICLR 2022 Long-range Sequence Modeling with Predictable Sparse Attention ACL 2022 MixFormer: Mixing Features Across Windows and Dimensions CVPR 2022 Multi-Frequency Information Enhanced Channel Attention Module for Speaker Representation Learning Interspeech 2022 Partial Class Activation Attention for Semantic Segmentation CVPR 2022 Sparse Attention with Learning to Hash ICLR 2022 Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation ICLR 2022 Abusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention AAAI 2021 Attention Calibration for Transformer in Neural Machine Translation ACL 2021 Context-aware Attentional Pooling (CAP) for Fine-grained Visual Classification AAAI 2021 Context-Aware Interaction Network for Question Matching EMNLP 2021 DEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION ICLR 2021 Dynamic Head: Unifying Object Detection Heads With Attentions CVPR 2021 EDNet: Efficient Disparity Estimation With Cost Volume Combination and Attention-Based Spatial Residual CVPR 2021 Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience EMNLP 2021 Gaussian Context Transformer CVPR 2021 Group Equivariant Stand-Alone Self-Attention For Vision ICLR 2021 Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classification ACL 2021 On Scalar Embedding of Relative Positions in Attention Models AAAI 2021 On the Dynamics of Training Attention Models ICLR 2021 Random Feature Attention ICLR 2021