conftrace_

self-supervised pretraining

85 papers

Explore in graph

Also known as

SSP

Co-occurring keywords

self-supervised learning (3777) transfer learning (5449) representation learning (6206) contrastive learning (4032) graph neural network (3962) multimodal learning (4645) masked autoencoder (203) few-shot learning (3398) vision transformer (1106) self-supervised pre-training (87)

Papers

Facebook AI’s WMT20 News Translation Task Submission EMNLP 2020
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning CVPR 2020
Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually) EMNLP 2020
Multi-pretraining for Large-scale Text Classification EMNLP 2020
Pretrained Transformers Improve Out-of-Distribution Robustness ACL 2020
Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers ICML 2020
Self-Supervised Pretraining with DICOM metadata in Ultrasound Imaging MLHC 2020
How Useful Is Self-Supervised Pretraining for Visual Tasks? CVPR 2020
Cloze-driven Pretraining of Self-attention Networks EMNLP 2019
Evaluating Protein Transfer Learning with TAPE NIPS 2019