← Keywords

unsupervised pretraining

38 papers

Explore in graph

Co-occurring keywords

representation learning (6174) language model (4573) contrastive learning (3979) unsupervised learning (3255) self-supervised learning (3751) question answering (2904) object detection (2759) masked language modeling (315) open-domain question answering (173) transfer learning (5442)

Papers

DocFormer: End-to-End Transformer for Document Understanding ICCV 2021
End-to-End Training of Neural Retrievers for Open-Domain Question Answering ACL 2021
Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity COLING 2020
Speech-XLNet: Unsupervised Acoustic Model Pretraining for Self-Attention Networks INTERSPEECH 2020
Pretraining Methods for Dialog Context Representation Learning ACL 2019
Data-Efficient Goal-Oriented Conversation with Dialogue Knowledge Transfer Networks IJCNLP 2019
SciBERT: A Pretrained Language Model for Scientific Text EMNLP 2019
Cross-Lingual Training for Automatic Question Generation ACL 2019
Unsupervised Pretraining for Neural Machine Translation Using Elastic Weight Consolidation ACL 2019
Unsupervised Pretraining for Sequence to Sequence Learning EMNLP 2017
Learning Non-Linear Reconstruction Models for Image Set Classification CVPR 2014
Top-Down Regularization of Deep Belief Networks NIPS 2013
Greedy Layer-Wise Training of Deep Networks NIPS 2006