conftrace_

model pre-training

12 papers

Explore in graph

Co-occurring keywords

self-supervised learning (3777) transfer learning (5449) speech translation (416) efficient computing (781) data augmentation (3052) differential privacy (1016) model compression (3302) speech alignment (8) document-grounded dialogue (22) goal oriented dialog (2)

Papers

Masking meets Supervision: A Strong Learning Alliance CVPR 2025
Pre-training Differentially Private Models with Limited Public Data NIPS 2024
Exploring Quantization for Efficient Pre-Training of Transformer Language Models EMNLP 2024
nanoT5: Fast & Simple Pre-training and Fine-tuning of T5 Models with Limited Resources EMNLP 2023
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute INTERSPEECH 2023
AdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translation EMNLP 2023
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations ACL 2023
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022
Building Goal-oriented Document-grounded Dialogue Systems ACL 2021
Differentially Private Language Models Benefit from Public Pre-training EMNLP 2020
Investigating Self-Supervised Pre-Training for End-to-End Speech Translation INTERSPEECH 2020
UdS-DFKI@WMT20: Unsupervised MT and Very Low Resource Supervised MT for German-Upper Sorbian EMNLP 2020