← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Practical One-Shot Federated Learning for Cross-Silo Setting IJCAI 2021
Fair Feature Distillation for Visual Recognition CVPR 2021
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation CVPR 2021
Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution CVPR 2021
General Instance Distillation for Object Detection CVPR 2021
Multi-Scale Aligned Distillation for Low-Resolution Detection CVPR 2021
Semi-Supervised Domain Adaptation Based on Dual-Level Domain Mixing for Semantic Segmentation CVPR 2021
Distilling Knowledge via Knowledge Review CVPR 2021
When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks CVPR 2021
Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with Unlabeled Data NIPS 2021
Scaling Ensemble Distribution Distillation to Many Classes with Proxy Targets NIPS 2021
Student-Teacher Learning From Clean Inputs to Noisy Inputs CVPR 2021
Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021
Content-Aware GAN Compression CVPR 2021
Positive-Unlabeled Data Purification in the Wild for Object Detection CVPR 2021
Distilling Object Detectors via Decoupled Features CVPR 2021
Learning Student Networks in the Wild CVPR 2021
Cross-Oilfield Reservoir Classification via Multi-Scale Sensor Knowledge Transfer AAAI 2021
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding AAAI 2021
PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive Learning AAAI 2021
The Curious Case of Hallucinations in Neural Machine Translation NAACL 2021
Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation NAACL 2021
Multi-Grained Knowledge Distillation for Named Entity Recognition NAACL 2021
Sampling and Filtering of Neural Machine Translation Distillation Data NAACL 2021
Cost-effective Deployment of BERT Models in Serverless Environment NAACL 2021