← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

3D Hand Pose Estimation with Disentangled Cross-Modal Latent Space WACV 2020
Hierarchical Pre-training for Sequence Labelling in Spoken Dialog EMNLP 2020
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers EMNLP 2020
Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020
AdapterHub: A Framework for Adapting Transformers EMNLP 2020
Multi-Modality Matters: A Performance Leap on VoxCeleb INTERSPEECH 2020
A Hybrid Deep Learning Approach for Spatial Trigger Extraction from Radiology Reports EMNLP 2020
CiteQA@CLSciSumm 2020 EMNLP 2020
Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks EMNLP 2020
CancerEmo: A Dataset for Fine-Grained Emotion Detection EMNLP 2020
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers EMNLP 2020
Which *BERT? A Survey Organizing Contextualized Encoders EMNLP 2020
AtLoc: Attention Guided Camera Localization AAAI 2020
FAN-Face: a Simple Orthogonal Improvement to Deep Face Recognition AAAI 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding EMNLP 2020
Transformers: State-of-the-Art Natural Language Processing EMNLP 2020
SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge EMNLP 2020
Long Short-Term Sample Distillation AAAI 2020
Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretraining INTERSPEECH 2020
Robust Named Entity Recognition with Truecasing Pretraining AAAI 2020
Exploring Transformers for Large-Scale Speech Recognition INTERSPEECH 2020
Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation ACL 2020
Span Selection Pre-training for Question Answering ACL 2020
Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models ACL 2020
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension ACL 2020