Pretraining

TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction NAACL 2021 Transformer Based End-to-End Mispronunciation Detection and Diagnosis Interspeech 2021 TreeBERT: A tree-based pre-trained model for programming language UAI 2021 Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer NeurIPS 2021 UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training CVPR 2021 UIBert: Learning Generic Multimodal Representations for UI Understanding IJCAI 2021 Unsupervised Learning of 3D Object Categories From Videos in the Wild CVPR 2021 Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation SemEval 2021 Using Large Self-Supervised Models for Low-Resource Speech Recognition Interspeech 2021 VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation ACL 2021 VirTex: Learning Visual Representations From Textual Annotations CVPR 2021 Visually-Grounded Library of Behaviors for Manipulating Diverse Objects across Diverse Configurations and Views CoRL 2021 Visual Transformers for Primates Classification and Covid Detection Interspeech 2021 Voice2Series: Reprogramming Acoustic Models for Time Series Classification ICML 2021 Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognition EMNLP 2021 WavBERT: Exploiting Semantic and Non-Semantic Speech Using Wav2vec and BERT for Dementia Detection Interspeech 2021 What Makes Instance Discrimination Good for Transfer Learning? ICLR 2021 When Do You Need Billions of Words of Pretraining Data? ACL 2021 Whitening for Self-Supervised Representation Learning ICML 2021 With a Little Help From My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations ICCV 2021 Writing Polishment with Simile: Task, Dataset and A Neural Approach AAAI 2021 YNU-HPCC at SemEval-2021 Task 5: Using a Transformer-based Model with Auxiliary Information for Toxic Span Detection SemEval 2021 3D Hand Pose Estimation with Disentangled Cross-Modal Latent Space WACV 2020 A Baseline for Few-Shot Image Classification ICLR 2020 AdapterHub: A Framework for Adapting Transformers EMNLP 2020