self-attention mechanism

AutoBERT-Zero: Evolving BERT Backbone from Scratch AAAI 2022 Beyond Fixation: Dynamic Window Visual Transformer CVPR 2022 Blockwise Sequential Model Learning for Partially Observable Reinforcement Learning AAAI 2022 CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification CVPR 2022 ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer ACL 2022 Composition, Attention, or Both? EMNLP 2022 Cross Aggregation Transformer for Image Restoration NeurIPS 2022 CSWin Transformer: A General Vision Transformer Backbone With Cross-Shaped Windows CVPR 2022 DeepQR: Neural-Based Quality Ratings for Learnersourced Multiple-Choice Questions AAAI 2022 Dependency Position Encoding for Relation Extraction NAACL 2022 Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze? ACL 2022 DRAG: Dynamic Region-Aware GCN for Privacy-Leaking Image Detection AAAI 2022 Dynamic Position Encoding for Transformers COLING 2022 Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention NAACL 2022 Eye Gaze and Self-attention: How Humans and Transformers Attend Words in Sentences ACL 2022 Fast Monte-Carlo Approximation of the Attention Mechanism AAAI 2022 Fast Vision Transformers with HiLo Attention NeurIPS 2022 Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT ACL 2022 Fine-Tuning Pre-trained Transformers into Decaying Fast Weights EMNLP 2022 Geodesic Self-Attention for 3D Point Clouds NeurIPS 2022 Geometric Transformer for End-to-End Molecule Properties Prediction IJCAI 2022 Geometry-Contrastive Transformer for Generalized 3D Pose Transfer AAAI 2022 Input-specific Attention Subnetworks for Adversarial Detection ACL 2022 Learning Multiscale Transformer Models for Sequence Generation ICML 2022 Lite Vision Transformer With Enhanced Self-Attention CVPR 2022