← Keywords

unsupervised pretraining

38 papers

Explore in graph

Co-occurring keywords

representation learning (6174) language model (4573) contrastive learning (3979) unsupervised learning (3255) self-supervised learning (3751) question answering (2904) object detection (2759) masked language modeling (315) open-domain question answering (173) transfer learning (5442)

Papers

Instruction-Tuned English to Bhojpuri Neural Machine Translation Using Contrastive Preference Optimization EMNLP 2025
Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning NIPS 2024
QDETRv: Query-Guided DETR for One-Shot Object Localization in Videos AAAI 2024
DocFormerv2: Local Features for Document Understanding AAAI 2024
FUG: Feature-Universal Graph Contrastive Pre-training for Graphs with Diverse Node Features NIPS 2024
Revisiting Convolution-free Transformer for Speech Recognition INTERSPEECH 2024
On the Generalization Ability of Unsupervised Pretraining AISTATS 2024
Learning to Speak from Text: Zero-Shot Multilingual Text-to-Speech with Unsupervised Text Pretraining IJCAI 2023
Socratic Pretraining: Question-Driven Pretraining for Controllable Summarization ACL 2023
Towards Robust Family-Infant Audio Analysis Based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio INTERSPEECH 2023
Future-conditioned Unsupervised Pretraining for Decision Transformer ICML 2023
Gold-YOLO: Efficient Object Detector via Gather-and-Distribute Mechanism NIPS 2023
Unsupervised Improvement of Factual Knowledge in Language Models EACL 2023
Salient Span Masking for Temporal Understanding EACL 2023
Unsupervised Pre-training Improves Tooth Segmentation in 3-Dimensional Intraoral Mesh Scans MIDL 2022
DETReg: Unsupervised Pretraining With Region Priors for Object Detection CVPR 2022
Palm up: Playing in the Latent Manifold for Unsupervised Pretraining NIPS 2022
TLDR at SemEval-2022 Task 1: Using Transformers to Learn Dictionaries and Representations NAACL 2022
Unsupervised Object Detection Pretraining with Joint Object Priors Generation and Detector Learning NIPS 2022
Learning to Retrieve Passages without Supervision NAACL 2022
TLDR at SemEval-2022 Task 1: Using Transformers to Learn Dictionaries and Representations SEMEVAL 2022
Representation Matters: Offline Pretraining for Sequential Decision Making ICML 2021
Language Recognition Based on Unsupervised Pretrained Models INTERSPEECH 2021
End-to-End Training of Neural Retrievers for Open-Domain Question Answering IJCNLP 2021
Improve Unsupervised Pretraining for Few-Label Transfer ICCV 2021