← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

A Systematic Comparison of Phonetic Aware Techniques for Speech Enhancement INTERSPEECH 2022
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT INTERSPEECH 2022
Exploring Capabilities of Monolingual Audio Transformers using Large Datasets in Automatic Speech Recognition of Czech INTERSPEECH 2022
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale INTERSPEECH 2022
VoiceMe: Personalized voice generation in TTS INTERSPEECH 2022
CTRL: Continual Representation Learning to Transfer Information of Pre-trained for WAV2VEC 2.0 INTERSPEECH 2022
Adaptive multilingual speech recognition with pretrained models INTERSPEECH 2022
Scaling ASR Improves Zero and Few Shot Learning INTERSPEECH 2022
Investigation of Ensemble features of Self-Supervised Pretrained Models for Automatic Speech Recognition INTERSPEECH 2022
Automatic Prosody Annotation with Pre-Trained Text-Speech Model INTERSPEECH 2022
Deep Audio Waveform Prior INTERSPEECH 2022
A Deep Learning Platform for Language Education Research and Development INTERSPEECH 2022
Pre-trained Speech Representations as Feature Extractors for Speech Quality Assessment in Online Conferencing Applications INTERSPEECH 2022
DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores INTERSPEECH 2022
WeSinger: Data-augmented Singing Voice Synthesis with Auxiliary Losses INTERSPEECH 2022
Towards Improving the Expressiveness of Singing Voice Synthesis with BERT Derived Semantic Information INTERSPEECH 2022
Plugging a neural phoneme recognizer into a simple language model: a workflow for low-resource setting INTERSPEECH 2022
Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech INTERSPEECH 2022
Can Vision Transformers Learn without Natural Images? AAAI 2022
XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge AAAI 2022
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding AAAI 2022
FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining ACL 2022
Generative Pretraining for Paraphrase Evaluation ACL 2022
A Neural Network Architecture for Program Understanding Inspired by Human Behaviors ACL 2022
Finding Structural Knowledge in Multimodal-BERT ACL 2022