Pretraining

RIVA: A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER COLING 2020 Robust Named Entity Recognition with Truecasing Pretraining AAAI 2020 Roles and Utilization of Attention Heads in Transformer-based Neural Language Models ACL 2020 Self-Supervised Learning of Pretext-Invariant Representations CVPR 2020 Self-supervised learning through the eyes of a child NeurIPS 2020 Self-Supervised Pretraining with DICOM metadata in Ultrasound Imaging MLHC 2020 Self-Supervised Visual Representation Learning from Hierarchical Grouping NeurIPS 2020 Semantic Mask for Transformer Based End-to-End Speech Recognition Interspeech 2020 Semantics-Aware BERT for Language Understanding AAAI 2020 SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles SemEval 2020 SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge EMNLP 2020 Should You Fine-Tune BERT for Automated Essay Scoring? ACL 2020 SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis ACL 2020 Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations ACL 2020 Span Selection Pre-training for Question Answering ACL 2020 Speech Representation Learning for Emotion Recognition Using End-to-End ASR with Factorized Adaptation Interspeech 2020 Stochastic Weight Averaging in Parallel: Large-Batch Training That Generalizes Well ICLR 2020 Strategies for Pre-training Graph Neural Networks ICLR 2020 Streaming On-Device End-to-End ASR System for Privacy-Sensitive Voice-Typing Interspeech 2020 Surface Realization Using Pretrained Language Models COLING 2020 Tangent Images for Mitigating Spherical Distortion CVPR 2020 TaPas: Weakly Supervised Table Parsing via Pre-training ACL 2020 Team_Swift at SemEval-2020 Task 9: Tiny Data Specialists through Domain-Specific Pre-training on Code-Mixed Data SemEval 2020 TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising EMNLP 2020 Texture and Shape Biased Two-Stream Networks for Clothing Classification and Attribute Recognition CVPR 2020