teacher model

Frequency Attention for Knowledge Distillation WACV 2024 From Coarse to Fine: Enable Comprehensive Graph Self-supervised Learning with Multi-granular Semantic Ensemble ICML 2024 How to Train the Teacher Model for Effective Knowledge Distillation ECCV 2024 Knowledge Distillation Based on Transformed Teacher Matching ICLR 2024 Knowledge Distillation with Auxiliary Variable ICML 2024 Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation ECCV 2024 MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training ICLR 2024 Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NeurIPS 2024 Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024 Self-Regulated Data-Free Knowledge Amalgamation for Text Classification NAACL 2024 Semi-supervised Segmentation of Histopathology Images with Noise-Aware Topological Consistency ECCV 2024 Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024 Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024 Adversarial Local Distribution Regularization for Knowledge Distillation WACV 2023 A Simple Concatenation can Effectively Improve Speech Translation ACL 2023 Cost-effective Distillation of Large Language Models ACL 2023 HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers ICLR 2023 IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation IJCAI 2023 KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation EMNLP 2023 Knowledge Distillation Performs Partial Variance Reduction NeurIPS 2023 Scaffolding a Student to Instill Knowledge ICLR 2023 ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023 SKDBERT: Compressing BERT via Stochastic Knowledge Distillation AAAI 2023 Churn Reduction via Distillation ICLR 2022 COACH: Cooperative Robot Teaching CoRL 2022