← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Generation-Focused Table-Based Intermediate Pre-training for Free-Form Question Answering AAAI 2022
Frozen Pretrained Transformers as Universal Computation Engines AAAI 2022
End-to-End Generative Pretraining for Multimodal Video Captioning CVPR 2022
Revisiting Weakly Supervised Pre-Training of Visual Perception Models CVPR 2022
Advancing High-Resolution Video-Language Representation With Large-Scale Video Transcriptions CVPR 2022
Unleashing Potential of Unsupervised Pre-Training With Intra-Identity Regularization for Person Re-Identification CVPR 2022
V-Doc: Visual Questions Answers With Documents CVPR 2022
Vision-Language Pre-Training for Boosting Scene Text Detectors CVPR 2022
Dynamic Scene Graph Generation via Anticipatory Pre-Training CVPR 2022
Robust Cross-Modal Representation Learning With Progressive Self-Distillation CVPR 2022
Towards Weakly-Supervised Text Spotting Using a Multi-Task Transformer CVPR 2022
FLAVA: A Foundational Language and Vision Alignment Model CVPR 2022
MERLOT Reserve: Neural Script Knowledge Through Vision and Language and Sound CVPR 2022
XMP-Font: Self-Supervised Cross-Modality Pre-Training for Few-Shot Font Generation CVPR 2022
Knowledge Distillation With the Reused Teacher Classifier CVPR 2022
ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakers ICML 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022
ConnPrompt: Connective-cloze Prompt Learning for Implicit Discourse Relation Recognition COLING 2022
DocQueryNet: Value Retrieval with Arbitrary Queries for Form-like Documents COLING 2022
Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation COLING 2022
CogBERT: Cognition-Guided Pre-trained Language Models COLING 2022
MaxMatch-Dropout: Subword Regularization for WordPiece COLING 2022
Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models NAACL 2022
Adaptable Adapters NAACL 2022
Improving negation detection with negation-focused pre-training NAACL 2022