self-supervised pretraining

Weakly-supervised Text Classification Based on Keyword Graph EMNLP 2021 Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning CVPR 2020 Facebook AI’s WMT20 News Translation Task Submission EMNLP 2020 How Useful Is Self-Supervised Pretraining for Visual Tasks? CVPR 2020 Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually) EMNLP 2020 Multi-pretraining for Large-scale Text Classification EMNLP 2020 Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation EMNLP 2020 Pretrained Transformers Improve Out-of-Distribution Robustness ACL 2020 RecoBERT: A Catalog Language Model for Text-Based Recommendations EMNLP 2020 Robust Pre-Training by Adversarial Contrastive Learning NeurIPS 2020 Self-Supervised Pre-Training with Acoustic Configurations for Replay Spoofing Detection Interspeech 2020 Self-Supervised Pretraining with DICOM metadata in Ultrasound Imaging MLHC 2020 Self-Supervised Representations Improve End-to-End Speech Translation Interspeech 2020 Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers ICML 2020 Cloze-driven Pretraining of Self-attention Networks EMNLP 2019 Evaluating Protein Transfer Learning with TAPE NeurIPS 2019