Pretraining
2,736 papers
Papers per year
1
2
1
1
1
4
5
19
26
34
111
209
262
333
490
570
502
165
'10
'15
'20
'25
Papers
CiteQA@CLSciSumm 2020
EMNLP 2020
CitiusNLP at SemEval-2020 Task 3: Comparing Two Approaches for Word Vector Contextualization
SemEval 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
EMNLP 2020
Coding Textual Inputs Boosts the Accuracy of Neural Networks
EMNLP 2020
ComplexDataLab at W-NUT 2020 Task 2: Detecting Informative COVID-19 Tweets by Attending over Linked Documents
EMNLP 2020
Contrastive Distillation on Intermediate Representations for Language Model Compression
EMNLP 2020
ConveRT: Efficient and Accurate Conversational Representations from Transformers
EMNLP 2020
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media
EMNLP 2020
Countering Language Drift with Seeded Iterated Learning
ICML 2020
Creating Something From Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing
CVPR 2020
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study
EMNLP 2020
CSP:Code-Switching Pre-training for Neural Machine Translation
EMNLP 2020
D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
CVPR 2020
Decentralized Deep Learning with Arbitrary Communication Compression
ICLR 2020
Deep Active Learning for Sequence Labeling Based on Diversity and Uncertainty in Gradient
AACL 2020
Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction
AAAI 2020
DoTheMath at SemEval-2020 Task 12 : Deep Neural Networks with Self Attention for Arabic Offensive Language Detection
SemEval 2020
ECHR: Legal Corpus for Argument Mining
COLING 2020
Efficient Intent Detection with Dual Sentence Encoders
ACL 2020
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
ICLR 2020
Emergent Communication Pretraining for Few-Shot Machine Translation
COLING 2020
Energy-based Self-attentive Learning of Abstractive Communities for Spoken Language Understanding
AACL 2020
Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking
EMNLP 2020
Enhancing Question Answering by Injecting Ontological Knowledge through Regularization
EMNLP 2020
Entity Enhanced BERT Pre-training for Chinese NER
EMNLP 2020