Pretraining

Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models ACL 2022 Conditional Image Generation by Conditioning Variational Auto-Encoders ICLR 2022 Conditional Prompt Learning for Vision-Language Models CVPR 2022 ConnPrompt: Connective-cloze Prompt Learning for Implicit Discourse Relation Recognition COLING 2022 ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakers ICML 2022 Continued Pretraining for Better Zero- and Few-Shot Promptability EMNLP 2022 Controlled Language Generation for Language Learning Items EMNLP 2022 Convergent Representations of Computer Programs in Human and Artificial Neural Networks NeurIPS 2022 ConvTrans: Transforming Web Search Sessions for Conversational Dense Retrieval EMNLP 2022 CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion NeurIPS 2022 Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition Interspeech 2022 CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data CVPR 2022 Cross-modal Contrastive Learning for Speech Translation NAACL 2022 Cross-Modal Mutual Learning for Audio-Visual Speech Recognition and Manipulation AAAI 2022 CTRL: Continual Representation Learning to Transfer Information of Pre-trained for WAV2VEC 2.0 Interspeech 2022 Data Contamination: From Memorization to Exploitation ACL 2022 DAVINZ: Data Valuation using Deep Neural Networks at Initialization ICML 2022 DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores Interspeech 2022 Deep Audio Waveform Prior Interspeech 2022 Deep Bidirectional Language-Knowledge Graph Pretraining NeurIPS 2022 Deep Compression of Pre-trained Transformer Models NeurIPS 2022 DEEP: DEnoising Entity Pre-training for Neural Machine Translation ACL 2022 Deep Learning for Model Correction in Cardiac Electrophysiological Imaging MIDL 2022 Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code IJCAI 2022 Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models Interspeech 2022