transformer architecture

What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? ICML 2022 What Language Model to Train if You Have One Million GPU Hours? EMNLP 2022 Where Does Linguistic Information Emerge in Neural Language Models? Measuring Gains and Contributions across Layers COLING 2022 WT-MVSNet: Window-based Transformers for Multi-view Stereo NeurIPS 2022 You Only Need One Model for Open-domain Question Answering EMNLP 2022 Your Transformer May Not be as Powerful as You Expect NeurIPS 2022 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds ICCV 2021 ACT: an Attentive Convolutional Transformer for Efficient Text Classification AAAI 2021 Action-Conditioned 3D Human Motion Synthesis With Transformer VAE ICCV 2021 AdaBins: Depth Estimation Using Adaptive Bins CVPR 2021 Adapted End-to-End Coreference Resolution System for Anaphoric Identities in Dialogues EMNLP 2021 AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting ICCV 2021 Aligning Subtitles in Sign Language Videos ICCV 2021 Allegro.eu Submission to WMT21 News Translation Task EMNLP 2021 AMR Parsing with Action-Pointer Transformer NAACL 2021 Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence Encoders AAAI 2021 ANVITA Machine Translation System for WAT 2021 MultiIndicMT Shared Task ACL 2021 A Package for Learning on Tabular and Text Data with Transformers NAACL 2021 Are Pretrained Convolutions Better than Pretrained Transformers? ACL 2021 A Simple and Effective Positional Encoding for Transformers EMNLP 2021 Associating Objects with Transformers for Video Object Segmentation NeurIPS 2021 A Transformer Based Approach towards Identification of Discourse Unit Segments and Connectives EMNLP 2021 Attention Bottlenecks for Multimodal Fusion NeurIPS 2021 Attention Calibration for Transformer in Neural Machine Translation ACL 2021 Attention is not all you need: pure attention loses rank doubly exponentially with depth ICML 2021