unsupervised pretraining

Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity COLING 2020 Speech-XLNet: Unsupervised Acoustic Model Pretraining for Self-Attention Networks Interspeech 2020 Combining Unsupervised Pre-training and Annotator Rationales to Improve Low-shot Text Classification EMNLP 2019 Cross-Lingual Training for Automatic Question Generation ACL 2019 Empirical Evaluation of Active Learning Techniques for Neural MT EMNLP 2019 Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data ACL 2019 Pretraining Methods for Dialog Context Representation Learning ACL 2019 SciBERT: A Pretrained Language Model for Scientific Text EMNLP 2019 Unsupervised Pretraining for Neural Machine Translation Using Elastic Weight Consolidation ACL 2019 Unsupervised Pre-Training of Image Features on Non-Curated Data ICCV 2019 wav2vec: Unsupervised Pre-Training for Speech Recognition Interspeech 2019 Unsupervised Pretraining for Sequence to Sequence Learning EMNLP 2017 Improving Deep Neural Networks Based Speaker Verification Using Unlabeled Data Interspeech 2016 Learning Non-Linear Reconstruction Models for Image Set Classification CVPR 2014 Top-Down Regularization of Deep Belief Networks NeurIPS 2013 Deep Sparse Rectifier Neural Networks AISTATS 2011 Why Does Unsupervised Pre-training Help Deep Learning? AISTATS 2010 Why Does Unsupervised Pre-training Help Deep Learning? JMLR 2010 Exploring Strategies for Training Deep Neural Networks JMLR 2009 Slow, Decorrelated Features for Pretraining Complex Cell-like Networks NeurIPS 2009 Greedy Layer-Wise Training of Deep Networks NeurIPS 2006