conftrace_
← Techniques
Deep Learning › Techniques ›

Pretraining

2,483 papers

Papers per year

1
5
219
374
'10
'15
'20
'25

Papers

AugCSE: Contrastive Sentence Embedding with Diverse Augmentations IJCNLP 2022
Affective Retrofitted Word Embeddings IJCNLP 2022
Enhancing Tabular Reasoning with Pattern Exploiting Training IJCNLP 2022
Fine-grained Contrastive Learning for Definition Generation IJCNLP 2022
CLIP4IDC: CLIP for Image Difference Captioning IJCNLP 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks IJCNLP 2022
Transformer-based Localization from Embodied Dialog with Large-scale Pre-training IJCNLP 2022
GCDT: A Chinese RST Treebank for Multigenre and Multilingual Discourse Parsing IJCNLP 2022
F-coref: Fast, Accurate and Easy to Use Coreference Resolution IJCNLP 2022
Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work IJCNLP 2022
When Cantonese NLP Meets Pre-training: Progress and Challenges IJCNLP 2022
Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition INTERSPEECH 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech INTERSPEECH 2022
A BERT-based Language Modeling Framework INTERSPEECH 2022
A Systematic Comparison of Phonetic Aware Techniques for Speech Enhancement INTERSPEECH 2022
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification INTERSPEECH 2022
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT INTERSPEECH 2022
Exploring Capabilities of Monolingual Audio Transformers using Large Datasets in Automatic Speech Recognition of Czech INTERSPEECH 2022
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale INTERSPEECH 2022
MAE-AST: Masked Autoencoding Audio Spectrogram Transformer INTERSPEECH 2022
VoiceMe: Personalized voice generation in TTS INTERSPEECH 2022
Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning INTERSPEECH 2022
Tokenwise Contrastive Pretraining for Finer Speech-to-BERT Alignment in End-to-End Speech-to-Intent Systems INTERSPEECH 2022
Deep Audio Waveform Prior INTERSPEECH 2022