Research Explorer
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Papers
Trends
Conferences
Explore
Authors
Topics
Keywords
Achievements
About
Methodology
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
Surface Realization Using Pretrained Language Models
COLING 2020
IITkgp at FinCausal 2020, Shared Task 1: Causality Detection using Sentence Embeddings in Financial Reports
COLING 2020
ECHR: Legal Corpus for Argument Mining
COLING 2020
Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks
COLING 2020
Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task
COLING 2020
Facts2Story: Controlling Text Generation by Key Facts
COLING 2020
RIVA: A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER
COLING 2020
Learning Efficient Task-Specific Meta-Embeddings with Word Prisms
COLING 2020
A Joint Learning Approach based on Self-Distillation for Keyphrase Extraction from Scientific Documents
COLING 2020
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing
JMLR 2020
Multi-level Alignment Pretraining for Multi-lingual Semantic Parsing
COLING 2020
YNU-HPCC at SemEval-2020 Task 11: LSTM Network for Detection of Propaganda Techniques in News Articles
COLING 2020
Zero-Shot Neural Machine Translation: Russian-Hindi @LoResMT 2020
AACL 2020
BYteam at SemEval-2020 Task 5: Detecting Counterfactual Statements with BERT and Ensembles
COLING 2020
SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles
COLING 2020
CyberWallE at SemEval-2020 Task 11: An Analysis of Feature Engineering for Ensemble Models for Propaganda Detection
COLING 2020
LT@Helsinki at SemEval-2020 Task 12: Multilingual or Language-specific BERT?
COLING 2020
Deep Active Learning for Sequence Labeling Based on Diversity and Uncertainty in Gradient
AACL 2020
Bi-directional CognitiveThinking Network for Machine Reading Comprehension
COLING 2020
Energy-based Self-attentive Learning of Abstractive Communities for Spoken Language Understanding
AACL 2020
Large-Scale Adversarial Training for Vision-and-Language Representation Learning
NIPS 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
ICML 2020
Learning and Evaluating Contextual Embedding of Source Code
ICML 2020
Emergent Communication Pretraining for Few-Shot Machine Translation
COLING 2020
Understanding tables with intermediate pre-training
EMNLP 2020
<
1
…
88
89
90
…
99
>