Pretraining

Reasoning Like Program Executors EMNLP 2022 ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples EMNLP 2022 Rethinking Supervised Pre-Training for Better Downstream Transferring ICLR 2022 Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training EMNLP 2022 Revisiting the Transferability of Supervised Pretraining: An MLP Perspective CVPR 2022 Revisiting Weakly Supervised Pre-Training of Visual Perception Models CVPR 2022 RIT Boston at SemEval-2022 Task 5: Multimedia Misogyny Detection By Using Coherent Visual and Language Features from CLIP Model and Data-centric AI Principle SemEval 2022 Robust Cross-Modal Representation Learning With Progressive Self-Distillation CVPR 2022 Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees ICML 2022 Romanian Language Translation in the RELATE Platform COLING 2022 ROSE: Robust Selective Fine-tuning for Pre-trained Language Models EMNLP 2022 RST Discourse Parsing with Second-Stage EDU-Level Pre-training ACL 2022 RuCoLA: Russian Corpus of Linguistic Acceptability EMNLP 2022 S2SNet: A Pretrained Neural Network for Superconductivity Discovery IJCAI 2022 Scale Efficiently: Insights from Pretraining and Finetuning Transformers ICLR 2022 Scaling ASR Improves Zero and Few Shot Learning Interspeech 2022 Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning NeurIPS 2022 Scaling Vision Transformers CVPR 2022 Scenic: A JAX Library for Computer Vision Research and Beyond CVPR 2022 SCHA-VAE: Hierarchical Context Aggregation for Few-Shot Generation ICML 2022 Scheduled Multi-task Learning for Neural Chat Translation ACL 2022 Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformers NeurIPS 2022 SelfMix: Robust Learning against Textual Label Noise with Self-Mixup Training COLING 2022 Self-Supervised Models Are Continual Learners CVPR 2022 Self-Supervised Pretraining Improves Self-Supervised Pretraining WACV 2022