← Back to papers
2023 EMNLP EMNLP 2023

Baby Llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty

Authors

Inar Timiryasov , Jean-Loup Tastet
Download PDF

Related papers

Exploring Linguistic Probes for Morphological Generalization 2023
NameGuess: Column Name Expansion for Tabular Data 2023
Vision-Enhanced Semantic Entity Recognition in Document Images via Visually-Asymmetric Consistency Learning 2023
Improving Conversational Recommendation Systems via Bias Analysis and Language-Model-Enhanced Data Augmentation 2023
On the Calibration of Large Language Models and Alignment 2023