model pretraining

Stare at What You See: Masked Image Modeling Without Reconstruction CVPR 2023 The Effectiveness of MAE Pre-Pretraining for Billion-Scale Pretraining ICCV 2023 Towards Unifying Multi-Lingual and Cross-Lingual Summarization ACL 2023 Unleashing Vanilla Vision Transformer with Masked Image Modeling for Object Detection ICCV 2023 AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification Interspeech 2022 Exploring Capabilities of Monolingual Audio Transformers using Large Datasets in Automatic Speech Recognition of Czech Interspeech 2022 Investigating Self-supervised Pretraining Frameworks for Pathological Speech Recognition Interspeech 2022 Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora ACL 2022 Masked Autoencoding for Scalable and Generalizable Decision Making NeurIPS 2022 Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022 PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining NAACL 2022 Parameter-Efficient Tuning Makes a Good Classification Head EMNLP 2022 Pre-Train, Self-Train, Distill: A Simple Recipe for Supersizing 3D Reconstruction CVPR 2022 Revisiting Weakly Supervised Pre-Training of Visual Perception Models CVPR 2022 Towards Unsupervised Domain Generalization CVPR 2022 A Package for Learning on Tabular and Text Data with Transformers NAACL 2021 Building Goal-oriented Document-grounded Dialogue Systems ACL 2021 Distributed Deep Learning In Open Collaborations NeurIPS 2021 NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection EMNLP 2021 Differentially Private Language Models Benefit from Public Pre-training EMNLP 2020 Investigating Self-Supervised Pre-Training for End-to-End Speech Translation Interspeech 2020 Transformers: State-of-the-Art Natural Language Processing EMNLP 2020 UdS-DFKI@WMT20: Unsupervised MT and Very Low Resource Supervised MT for German-Upper Sorbian EMNLP 2020 Snapshot Distillation: Teacher-Student Optimization in One Generation CVPR 2019