← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

ARMAN: Pre-training with Semantically Selecting and Reordering of Sentences for Persian Abstractive Summarization EMNLP 2021
GX at SemEval-2021 Task 2: BERT with Lemma Information for MCL-WiC Task SEMEVAL 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning ICML 2021
Counts@IITK at SemEval-2021 Task 8: SciBERT Based Entity And Semantic Relation Extraction For Scientific Data ACL 2021
LocTex: Learning Data-Efficient Visual Representations From Localized Textual Supervision ICCV 2021
Online Knowledge Distillation for Efficient Pose Estimation ICCV 2021
DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence From Box Supervision ICCV 2021
Topic Scene Graph Generation by Attention Distillation From Caption ICCV 2021
Seasonal Contrast: Unsupervised Pre-Training From Uncurated Remote Sensing Data ICCV 2021
How could Neural Networks understand Programs? ICML 2021
DirectQE: Direct Pretraining for Machine Translation Quality Estimation AAAI 2021
Writing Polishment with Simile: Task, Dataset and A Neural Approach AAAI 2021
Space-Time-Separable Graph Convolutional Network for Pose Forecasting ICCV 2021
PreDet: Large-Scale Weakly Supervised Pre-Training for Detection ICCV 2021
Forty Years of Speech and Language Processing: From Bayes Decision Rule to Deep Learning INTERSPEECH 2021
N-MTTL SI Model: Non-Intrusive Multi-Task Transfer Learning-Based Speech Intelligibility Prediction Model with Scenery Classification INTERSPEECH 2021
Emotion Recognition from Speech Using wav2vec 2.0 Embeddings INTERSPEECH 2021
LiRA: Learning Visual Speech Representations from Audio Through Self-Supervision INTERSPEECH 2021
Speech Denoising with Auditory Models INTERSPEECH 2021
SUPERB: Speech Processing Universal PERformance Benchmark INTERSPEECH 2021
Explaining Self-Supervised Image Representations with Visual Probing IJCAI 2021
WavBERT: Exploiting Semantic and Non-Semantic Speech Using Wav2vec and BERT for Dementia Detection INTERSPEECH 2021
PixelTransformer: Sample Conditioned Signal Generation ICML 2021
Learning Curves for Analysis of Deep Networks ICML 2021
Inducing Language-Agnostic Multilingual Representations IJCNLP 2021