← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers EMNLP 2020
ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training EMNLP 2020
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media EMNLP 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages EMNLP 2020
Predicting Responses to Psychological Questionnaires from Participants’ Social Media Posts and Question Text Embeddings EMNLP 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank EMNLP 2020
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study EMNLP 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing EMNLP 2020
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation EMNLP 2020
POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training EMNLP 2020
Reading the Manual: Event Extraction as Definition Comprehension EMNLP 2020
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information EMNLP 2020
TNT: Text Normalization based Pre-training of Transformers for Content Moderation EMNLP 2020
Multi-resolution Annotations for Emoji Prediction EMNLP 2020
ARBML: Democratizing Arabic Natural Language Processing Tools EMNLP 2020
CIA_NITT at WNUT-2020 Task 2: Classification of COVID-19 Tweets Using Pre-trained Language Models EMNLP 2020
With More Contexts Comes Better Performance: Contextualized Sense Embeddings for All-Round Word Sense Disambiguation EMNLP 2020
Towards Interpreting BERT for Reading Comprehension Based QA EMNLP 2020
CSP:Code-Switching Pre-training for Neural Machine Translation EMNLP 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training EMNLP 2020
Coding Textual Inputs Boosts the Accuracy of Neural Networks EMNLP 2020
What Have We Achieved on Text Summarization? EMNLP 2020
D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry CVPR 2020
Rethinking Computer-Aided Tuberculosis Diagnosis CVPR 2020
OASIS: A Large-Scale Dataset for Single Image 3D in the Wild CVPR 2020