← Keywords

model pretraining

35 papers

Explore in graph

Co-occurring keywords

transfer learning (5442) self-supervised learning (3751) representation learning (6174) language model (4573) language model pretraining (105) knowledge distillation (3680) masked image modeling (83) object detection (2759) zero-shot learning (3637) model compression (3283)

Papers

AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification INTERSPEECH 2022
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining NAACL 2022
Revisiting Weakly Supervised Pre-Training of Visual Perception Models CVPR 2022
Parameter-Efficient Tuning Makes a Good Classification Head EMNLP 2022
A Package for Learning on Tabular and Text Data with Transformers NAACL 2021
Bootstrapped Unsupervised Sentence Representation Learning IJCNLP 2021
NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection EMNLP 2021
Distributed Deep Learning In Open Collaborations NIPS 2021
Transformers: State-of-the-Art Natural Language Processing EMNLP 2020
Snapshot Distillation: Teacher-Student Optimization in One Generation CVPR 2019