← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

On the Evaluation of Speech Foundation Models for Spoken Language Understanding ACL 2024
Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation ACL 2024
Initializing Variable-sized Vision Transformers from Learngene with Learnable Transformation NIPS 2024
wav2vec-S: Adapting Pre-trained Speech Models for Streaming ACL 2024
Fully Few-shot Class-incremental Audio Classification Using Expandable Dual-embedding Extractor INTERSPEECH 2024
DATA-CUBE: Data Curriculum for Instruction-based Sentence Representation Learning ACL 2024
ManWav: The First Manchu ASR Model ACL 2024
IT5: Text-to-text Pretraining for Italian Language Understanding and Generation COLING 2024
Non-Linear Inference Time Intervention: Improving LLM Truthfulness INTERSPEECH 2024
Non-Intrusive Speech Intelligibility Prediction for Hearing Aids using Whisper and Metadata INTERSPEECH 2024
Quantifying Unintended Memorization in BEST-RQ ASR Encoders INTERSPEECH 2024
Pre-training Neural Transducer-based Streaming Voice Conversion for Faster Convergence and Alignment-free Training INTERSPEECH 2024
Parameter-efficient Fine-tuning of Speaker-Aware Dynamic Prompts for Speaker Verification INTERSPEECH 2024
Exploring adaptation techniques of large speech foundation models for low-resource ASR: a case study on Northern Sámi INTERSPEECH 2024
Memory-Efficient LLM Training with Online Subspace Descent NIPS 2024
Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of Speech-Silence and Word-Punctuation INTERSPEECH 2024
Efficient Integrated Features Based on Pre-trained Models for Speaker Verification INTERSPEECH 2024
Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking NIPS 2024
ASOS at OSACT6 Shared Task: Investigation of Data Augmentation in Arabic Dialect-MSA Translation COLING 2024
Fine-tune Pre-Trained Models with Multi-Level Feature Fusion for Speaker Verification INTERSPEECH 2024
Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models INTERSPEECH 2024
Speechworthy Instruction-tuned Language Models EMNLP 2024
Pre-training Feature Guided Diffusion Model for Speech Enhancement INTERSPEECH 2024
Pre-trained Feature Fusion and Matching for Mild Cognitive Impairment Detection INTERSPEECH 2024
Data, Data Everywhere: A Guide for Pretraining Dataset Construction EMNLP 2024