← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Cross-Layer Distillation with Semantic Calibration AAAI 2021
Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks AAAI 2021
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks AAAI 2021
PREMERE: Meta-Reweighting via Self-Ensembling for Point-of-Interest Recommendation AAAI 2021
Robust Knowledge Transfer via Hybrid Forward on the Teacher-Student Model AAAI 2021
Progressive Network Grafting for Few-Shot Knowledge Distillation AAAI 2021
KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation ICML 2021
Training data-efficient image transformers & distillation through attention ICML 2021
Model Distillation for Revenue Optimization: Interpretable Personalized Pricing ICML 2021
Simultaneous Similarity-based Self-Distillation for Deep Metric Learning ICML 2021
Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model ICML 2021
Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation WACV 2021
A statistical perspective on distillation ICML 2021
Towards Compact Single Image Super-Resolution via Contrastive Self-distillation IJCAI 2021
Class-Incremental Instance Segmentation via Multi-Teacher Networks AAAI 2021
Knowledge-based Residual Learning IJCAI 2021
Automatic Mixed-Precision Quantization Search of BERT IJCAI 2021
Drop Redundant, Shrink Irrelevant: Selective Knowledge Injection for Language Pretraining IJCAI 2021
FANS: Fusing ASR and NLU for On-Device SLU INTERSPEECH 2021
Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification INTERSPEECH 2021
CoDERT: Distilling Encoder Representations with Co-Learning for Transducer-Based Speech Recognition INTERSPEECH 2021
Weakly Supervised Dense Video Captioning via Jointly Usage of Knowledge Distillation and Cross-modal Matching IJCAI 2021
Context-Aware Image Inpainting with Learned Semantic Priors IJCAI 2021
Adjunct-Emeritus Distillation for Semi-Supervised Language Model Adaptation INTERSPEECH 2021
Bridging the Gap Between Streaming and Non-Streaming ASR Systems by Distilling Ensembles of CTC and RNN-T Models INTERSPEECH 2021