← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Learning to Retrieve Passages without Supervision NAACL 2022
Progressive Class Semantic Matching for Semi-supervised Text Classification NAACL 2022
On the Use of Bert for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation NAACL 2022
A Computational Acquisition Model for Multimodal Word Categorization NAACL 2022
Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation NAACL 2022
Collective Relevance Labeling for Passage Retrieval NAACL 2022
SSEGCN: Syntactic and Semantic Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis NAACL 2022
Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy NAACL 2022
Cross-modal Contrastive Learning for Speech Translation NAACL 2022
DynamicTOC: Persona-based Table of Contents for Consumption of Long Documents NAACL 2022
Self-supervised Representation Learning for Speech Processing NAACL 2022
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification INTERSPEECH 2022
MAE-AST: Masked Autoencoding Audio Spectrogram Transformer INTERSPEECH 2022
Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning INTERSPEECH 2022
Tokenwise Contrastive Pretraining for Finer Speech-to-BERT Alignment in End-to-End Speech-to-Intent Systems INTERSPEECH 2022
Exploring the influence of fine-tuning data on wav2vec 2.0 model for blind speech quality prediction INTERSPEECH 2022
Interpretabilty of Speech Emotion Recognition modelled using Self-Supervised Speech and Text Pre-Trained Embeddings INTERSPEECH 2022
UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022 INTERSPEECH 2022
Wav2vec behind the Scenes: How end2end Models learn Phonetics INTERSPEECH 2022
DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterances INTERSPEECH 2022
Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition INTERSPEECH 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
A BERT-based Language Modeling Framework INTERSPEECH 2022
Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routing AAAI 2022
Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIP AAAI 2022