Pretraining

IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization EMNLP 2021 InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective ICLR 2021 In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness ICLR 2021 INNOVATORS at SemEval-2021 Task-11: A Dependency Parsing and BERT-based model for Extracting Contribution Knowledge from Scientific Papers SemEval 2021 Investigating Pretrained Language Models for Graph-to-Text Generation EMNLP 2021 Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks EMNLP 2021 Is Pseudo-Lidar Needed for Monocular 3D Object Detection? ICCV 2021 JuriBERT: A Masked-Language Model Adaptation for French Legal Text EMNLP 2021 JUST-BLUE at SemEval-2021 Task 1: Predicting Lexical Complexity using BERT and RoBERTa Pre-trained Language Models SemEval 2021 KLMo: Knowledge Graph Enhanced Pretrained Language Model with Fine-Grained Relationships EMNLP 2021 KoDF: A Large-Scale Korean DeepFake Detection Dataset ICCV 2021 Language Model Pretraining and Transfer Learning for Very Low Resource Languages EMNLP 2021 Language Recognition Based on Unsupervised Pretrained Models Interspeech 2021 Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone Interspeech 2021 LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding ACL 2021 LayoutReader: Pre-training of Text and Layout for Reading Order Detection EMNLP 2021 LEAF: A Learnable Frontend for Audio Classification ICLR 2021 Learning Anchored Unsigned Distance Functions With Gradient Direction Alignment for Single-View Garment Reconstruction ICCV 2021 Learning Bill Similarity with Annotated and Augmented Corpora of Bills EMNLP 2021 Learning Curves for Analysis of Deep Networks ICML 2021 Learning Spatial-Semantic Relationship for Facial Attribute Recognition With Limited Labeled Data CVPR 2021 Learning to Pre-train Graph Neural Networks AAAI 2021 LeCun at SemEval-2021 Task 6: Detecting Persuasion Techniques in Text Using Ensembled Pretrained Transformers and Data Augmentation SemEval 2021 Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversations EMNLP 2021 Light Field Super-Resolution With Zero-Shot Learning CVPR 2021