Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
Meta-Transfer Learning for Zero-Shot Super-Resolution
CVPR 2020
Model Watermarking for Image Processing Networks
AAAI 2020
Towards Comprehensive Recommender Systems: Time-Aware Unified Recommendations Based on Listwise Ranking of Implicit Cross-Network Data
AAAI 2020
Semantics-Aware BERT for Language Understanding
AAAI 2020
Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction
AAAI 2020
Towards Making the Most of BERT in Neural Machine Translation
AAAI 2020
Masking Orchestration: Multi-Task Pretraining for Multi-Role Dialogue Representation Learning
AAAI 2020
Parsing as Pretraining
AAAI 2020
Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking
AAAI 2020
Multi-Task Self-Supervised Learning for Disfluency Detection
AAAI 2020
Order Matters: Semantic-Aware Neural Networks for Binary Code Similarity Detection
AAAI 2020
Team_Swift at SemEval-2020 Task 9: Tiny Data Specialists through Domain-Specific Pre-training on Code-Mixed Data
COLING 2020
Solomon at SemEval-2020 Task 11: Ensemble Architecture for Fine-Tuned Propaganda Detection in News Articles
COLING 2020
AlexU-BackTranslation-TL at SemEval-2020 Task 12: Improving Offensive Language Detection Using Data Augmentation and Transfer Learning
COLING 2020
Amsqr at SemEval-2020 Task 12: Offensive Language Detection Using Neural Networks and Anti-adversarial Features
COLING 2020
KFU NLP Team at SMM4H 2020 Tasks: Cross-lingual Transfer Learning with Pretrained Language Models for Drug Reactions
COLING 2020
Self-Supervised Visual Representation Learning from Hierarchical Grouping
NIPS 2020
Reed at SemEval-2020 Task 9: Fine-Tuning and Bag-of-Words Approaches to Code-Mixed Sentiment Analysis
COLING 2020
IRLab_DAIICT at SemEval-2020 Task 9: Machine Learning and Deep Learning Methods for Sentiment Analysis of Code-Mixed Tweets
COLING 2020
ELMo-NB at SemEval-2020 Task 7: Assessing Sense of Humor in EditedNews Headlines Using ELMo and NB
COLING 2020
BERTatDE at SemEval-2020 Task 6: Extracting Term-definition Pairs in Free Text Using Pre-trained Model
COLING 2020
TR at SemEval-2020 Task 4: Exploring the Limits of Language-model-based Common Sense Validation
COLING 2020
ACNLP at SemEval-2020 Task 6: A Supervised Approach for Definition Extraction
COLING 2020
HIT-SCIR at SemEval-2020 Task 5: Training Pre-trained Language Model with Pseudo-labeling Data for Counterfactuals Detection
COLING 2020
Learning Emotion from 100 Observations: Unexpected Robustness of Deep Learning under Strong Data Limitations
COLING 2020
<
1
…
87
88
89
…
99
>