Pretraining

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis CVPR 2022 Self-supervised Representation Learning for Speech Processing NAACL 2022 Self-Supervised Shape Alignment for Sports Field Registration WACV 2022 Semantic-based Pre-training for Dialogue Understanding COLING 2022 SemEval-2022 Task 3: PreTENS-Evaluating Neural Networks on Presuppositional Semantic Knowledge SemEval 2022 Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systems EMNLP 2022 Silo NLP’s Participation at WAT2022 COLING 2022 SimMIM: A Simple Framework for Masked Image Modeling CVPR 2022 Simple but Effective: CLIP Embeddings for Embodied AI CVPR 2022 SkoltechNLP at SemEval-2022 Task 8: Multilingual News Article Similarity via Exploration of News Texts to Vector Representations SemEval 2022 Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation EMNLP 2022 Sound and Visual Representation Learning With Multiple Pretraining Tasks CVPR 2022 Spatiotemporal Initialization for 3D CNNs With Generated Motion Patterns WACV 2022 Spectral Probing EMNLP 2022 SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing ACL 2022 S-Prompts Learning with Pre-trained Transformers: An Occam’s Razor for Domain Incremental Learning NeurIPS 2022 SRCB at SemEval-2022 Task 5: Pretraining Based Image to Text Late Sequential Fusion System for Multimodal Misogynous Meme Identification SemEval 2022 SSEGCN: Syntactic and Semantic Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis NAACL 2022 Staged Training for Transformer Language Models ICML 2022 STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing EMNLP 2022 Striking a Balance: Alleviating Inconsistency in Pre-trained Models for Symmetric Classification Tasks ACL 2022 Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks EMNLP 2022 Swin Transformer V2: Scaling Up Capacity and Resolution CVPR 2022 SynthMap: a generative model for synthesis of 3D datasets for quantitative MRI parameter mapping of myelin water fraction MIDL 2022 Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks IJCAI 2022