conftrace_
← Techniques
Deep Learning › Techniques ›

Pretraining

2,483 papers

Papers per year

1
5
219
374
'10
'15
'20
'25

Papers

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training ICML 2020
Learning and Evaluating Contextual Embedding of Source Code ICML 2020
Countering Language Drift with Seeded Iterated Learning ICML 2020
Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020
EViLBERT: Learning Task-Agnostic Multimodal Sense Embeddings IJCAI 2020
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation IJCAI 2020
FinBERT: A Pre-trained Financial Language Representation Model for Financial Text Mining IJCAI 2020
ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition INTERSPEECH 2020
Speech Representation Learning for Emotion Recognition Using End-to-End ASR with Factorized Adaptation INTERSPEECH 2020
Semantic Mask for Transformer Based End-to-End Speech Recognition INTERSPEECH 2020
Multi-Encoder-Decoder Transformer for Code-Switching Speech Recognition INTERSPEECH 2020
A Deep 2D Convolutional Network for Waveform-Based Speech Recognition INTERSPEECH 2020
Lightweight End-to-End Speech Recognition from Raw Audio Data Using Sinc-Convolutions INTERSPEECH 2020
Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length Embedding INTERSPEECH 2020
Multi-Modality Matters: A Performance Leap on VoxCeleb INTERSPEECH 2020
Phoneme-to-Grapheme Conversion Based Large-Scale Pre-Training for End-to-End Automatic Speech Recognition INTERSPEECH 2020
Streaming On-Device End-to-End ASR System for Privacy-Sensitive Voice-Typing INTERSPEECH 2020
Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretraining INTERSPEECH 2020
The Zero Resource Speech Challenge 2020: Discovering Discrete Subword and Word Units INTERSPEECH 2020
Improving Transformer-Based Speech Recognition with Unsupervised Pre-Training and Multi-Task Semantic Knowledge Learning INTERSPEECH 2020
Exploring Transformers for Large-Scale Speech Recognition INTERSPEECH 2020
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing JMLR 2020
Extending Unsupervised Neural Image Compression With Supervised Multitask Learning MIDL 2020
Self-Supervised Pretraining with DICOM metadata in Ultrasound Imaging MLHC 2020
UPSTAGE: Unsupervised Context Augmentation for Utterance Classification in Patient-Provider Communication MLHC 2020