Pretraining

OCHADAI at SMM4H-2021 Task 5: Classifying self-reporting tweets on potential cases of COVID-19 by ensembling pre-trained language models NAACL 2021 On Equivariant and Invariant Learning of Object Landmark Representations ICCV 2021 Online Knowledge Distillation for Efficient Pose Estimation ICCV 2021 On Self-Supervised Image Representations for GAN Evaluation ICLR 2021 Optimizing Deeper Transformers on Small Datasets ACL 2021 Papago’s Submission for the WMT21 Quality Estimation Shared Task EMNLP 2021 Parameter Efficient Multimodal Transformers for Video Representation Learning ICLR 2021 Parrot: Data-Driven Behavioral Priors for Reinforcement Learning ICLR 2021 Partial transfusion: on the expressive influence of trainable batch norm parameters for transfer learning MIDL 2021 Phoneme Duration Modeling Using Speech Rhythm-Based Speaker Embeddings for Multi-Speaker Speech Synthesis Interspeech 2021 Phrase Break Prediction with Bidirectional Encoder Representations in Japanese Text-to-Speech Synthesis Interspeech 2021 Physics-Aware Downsampling with Deep Learning for Scalable Flood Modeling NeurIPS 2021 PixelTransformer: Sample Conditioned Signal Generation ICML 2021 PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction ACL 2021 PMI-Masking: Principled masking of correlated spans ICLR 2021 PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation ACL 2021 PreDet: Large-Scale Weakly Supervised Pre-Training for Detection ICCV 2021 Predicting Inductive Biases of Pre-Trained Models ICLR 2021 Pre-Trained Image Processing Transformer CVPR 2021 Pretrained Language Model for Text Generation: A Survey IJCAI 2021 Pretrain-Finetune Based Training of Task-Oriented Dialogue Systems in a Real-World Setting NAACL 2021 Pre-Training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning Interspeech 2021 Pre-training Universal Language Representation ACL 2021 Pri3D: Can 3D Priors Help 2D Representation Learning? ICCV 2021 Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training NeurIPS 2021