Pretraining

The birth of Romanian BERT EMNLP 2020 The Early Phase of Neural Network Training ICLR 2020 The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain ACL 2020 The Synthinel-1 dataset: a collection of high resolution synthetic overhead imagery for building segmentation WACV 2020 The Zero Resource Speech Challenge 2020: Discovering Discrete Subword and Word Units Interspeech 2020 TNT: Text Normalization based Pre-training of Transformers for Content Moderation EMNLP 2020 Towards Comprehensive Recommender Systems: Time-Aware Unified Recommendations Based on Listwise Ranking of Implicit Cross-Network Data AAAI 2020 Towards Interpreting BERT for Reading Comprehension Based QA EMNLP 2020 Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-Training CVPR 2020 Towards Making the Most of BERT in Neural Machine Translation AAAI 2020 Training with Noise Adversarial Network: A Generalization Method for Object Detection on Sonar Image WACV 2020 Transformers at SemEval-2020 Task 11: Propaganda Fragment Detection Using Diversified BERT Architectures Based Ensemble Learning SemEval 2020 Transformers: State-of-the-Art Natural Language Processing EMNLP 2020 TR at SemEval-2020 Task 4: Exploring the Limits of Language-model-based Common Sense Validation SemEval 2020 Understanding tables with intermediate pre-training EMNLP 2020 Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training AAAI 2020 UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database AACL 2020 UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training ICML 2020 Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers EMNLP 2020 UPSTAGE: Unsupervised Context Augmentation for Utterance Classification in Patient-Provider Communication MLHC 2020 Using Pre-Trained Transformer for Better Lay Summarization EMNLP 2020 Visual Commonsense R-CNN CVPR 2020 VL-BERT: Pre-training of Generic Visual-Linguistic Representations ICLR 2020 Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretraining Interspeech 2020 wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations NeurIPS 2020