conftrace_

transfer set

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

language model (2) knowledge distillation (2) context distillation (1) distillation (1) task-specific model (1) retrieval augmented (1) domain classification (1) knowledge update (1) student model (1) vision foundation model (1)

Papers

Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models ICML 2024 Propagating Knowledge Updates to LMs Through Distillation NeurIPS 2023 Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022