Co-occurring keywords · papers mentioning both
Papers
DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining
EMNLP 2023
DisWOT: Student Architecture Search for Distillation WithOut Training
CVPR 2023
DOT: A Distillation-Oriented Trainer
ICCV 2023
Dual Student Networks for Data-Free Model Stealing
ICLR 2023
HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers
ICLR 2023
IDEAL: Query-Efficient Data-Free Learning from Black-Box Models
ICLR 2023
IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation
IJCAI 2023
KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation
EMNLP 2023
Knowledge Distillation Performs Partial Variance Reduction
NeurIPS 2023
Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation
EMNLP 2023
Linkless Link Prediction via Relational Distillation
ICML 2023
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference
NeurIPS 2023
Scaffolding a Student to Instill Knowledge
ICLR 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector
CVPR 2023
SKDBERT: Compressing BERT via Stochastic Knowledge Distillation
AAAI 2023
Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval
CVPR 2023
COACH: Cooperative Robot Teaching
CoRL 2022
KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks
COLING 2022
Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability
CVPR 2022
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks
EMNLP 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching
NeurIPS 2022
Multi-Granularity Structural Knowledge Distillation for Language Model Compression
ACL 2022
RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
NAACL 2022
Respecting Transfer Gap in Knowledge Distillation
NeurIPS 2022
Rethinking Task-Specific Knowledge Distillation: Contextualized Corpus as Better Textbook
EMNLP 2022