Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
Image to Video Domain Adaptation Using Web Supervision
WACV 2020
Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning
WACV 2020
Alternating Language Modeling for Cross-Lingual Pre-Training
AAAI 2020
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training
AAAI 2020
SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles
SEMEVAL 2020
Transformers at SemEval-2020 Task 11: Propaganda Fragment Detection Using Diversified BERT Architectures Based Ensemble Learning
SEMEVAL 2020
MIDAS at SemEval-2020 Task 10: Emphasis Selection Using Label Distribution Learning and Contextual Embeddings
SEMEVAL 2020
ISCAS at SemEval-2020 Task 5: Pre-trained Transformers for Counterfactual Statement Modeling
SEMEVAL 2020
CitiusNLP at SemEval-2020 Task 3: Comparing Two Approaches for Word Vector Contextualization
SEMEVAL 2020
Team_Swift at SemEval-2020 Task 9: Tiny Data Specialists through Domain-Specific Pre-training on Code-Mixed Data
SEMEVAL 2020
MemoSYS at SemEval-2020 Task 8: Multimodal Emotion Analysis in Memes
SEMEVAL 2020
Memebusters at SemEval-2020 Task 8: Feature Fusion Model for Sentiment Analysis on Memes Using Transfer Learning
SEMEVAL 2020
KAFK at SemEval-2020 Task 8: Extracting Features from Pre-trained Neural Networks to Classify Internet Memes
SEMEVAL 2020
Infotec + CentroGEO at SemEval-2020 Task 8: Deep Learning and Text Categorization approach for Memes classification
SEMEVAL 2020
TR at SemEval-2020 Task 4: Exploring the Limits of Language-model-based Common Sense Validation
SEMEVAL 2020
HIT-SCIR at SemEval-2020 Task 5: Training Pre-trained Language Model with Pseudo-labeling Data for Counterfactuals Detection
SEMEVAL 2020
UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database
AACL 2020
Retiarii: A Deep Learning Exploratory-Training Framework
OSDI 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
NIPS 2020
Creating Something From Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing
CVPR 2020
How Useful Is Self-Supervised Pretraining for Visual Tasks?
CVPR 2020
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions
CVPR 2020
ComplexDataLab at W-NUT 2020 Task 2: Detecting Informative COVID-19 Tweets by Attending over Linked Documents
EMNLP 2020
MeDAL: Medical Abbreviation Disambiguation Dataset for Natural Language Understanding Pretraining
EMNLP 2020
Phoneme-to-Grapheme Conversion Based Large-Scale Pre-Training for End-to-End Automatic Speech Recognition
INTERSPEECH 2020
<
1
…
82
83
84
…
99
>