Transformers

ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias NeurIPS 2021 ViViT: A Video Vision Transformer ICCV 2021 VLN BERT: A Recurrent Vision-and-Language BERT for Navigation CVPR 2021 VMLoc: Variational Fusion For Learning-Based Multimodal Camera Localization AAAI 2021 Volta at SemEval-2021 Task 6: Towards Detecting Persuasive Texts and Images using Textual and Multimodal Ensemble SemEval 2021 Volta at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables using TAPAS and Transfer Learning SemEval 2021 Voxel Transformer for 3D Object Detection ICCV 2021 VTNet: Visual Transformer Network for Object Goal Navigation ICLR 2021 Vx2Text: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs CVPR 2021 WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning for Emotion Classification and Empathy Prediction EACL 2021 WavBERT: Exploiting Semantic and Non-Semantic Speech Using Wav2vec and BERT for Dementia Detection Interspeech 2021 WBI at MEDIQA 2021: Summarizing Consumer Health Questions with Generative Transformers NAACL 2021 Weakly-Supervised Speech-to-Text Mapping with Visually Connected Non-Parallel Speech-Text Data Using Cyclic Partially-Aligned Transformer Interspeech 2021 WeChat Neural Machine Translation Systems for WMT21 EMNLP 2021 WeNet: Production Oriented Streaming and Non-Streaming End-to-End Speech Recognition Toolkit Interspeech 2021 What Context Features Can Transformer Language Models Use? ACL 2021 What’s Hidden in a One-layer Randomly Weighted Transformer? EMNLP 2021 What’s in Your Head? Emergent Behaviour in Multi-Task Transformer Models EMNLP 2021 When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021 Which transformer architecture fits my data? A vocabulary bottleneck in self-attention ICML 2021 WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach EMNLP 2021 WLV-RIT at SemEval-2021 Task 5: A Neural Transformer Framework for Detecting Toxic Spans SemEval 2021 Word2Fun: Modelling Words as Functions for Diachronic Word Representation NeurIPS 2021 Word Embeddings, Cosine Similarity and Deep Learning for Identification of Professions & Occupations in Health-related Social Media NAACL 2021 Writing Polishment with Simile: Task, Dataset and A Neural Approach AAAI 2021