← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Being Friends Instead of Adversaries: Deep Networks Learn from Data Simplified by Other Networks AAAI 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
Knowledge Sharing via Domain Adaptation in Customs Fraud Detection AAAI 2022
EasySED: Trusted Sound Event Detection with Self-Distillation AAAI 2022
Discovering and Overcoming Limitations of Noise-engineered Data-free Knowledge Distillation NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
Mixture-of-Experts with Expert Choice Routing NIPS 2022
Weighted Mutual Learning with Diversity-Driven Model Compression NIPS 2022
Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks NIPS 2022
Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation NIPS 2022
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification NIPS 2022
Information-Theoretic GAN Compression with Variational Energy-based Model NIPS 2022
Towards Efficient 3D Object Detection with Knowledge Distillation NIPS 2022
DENSE: Data-Free One-Shot Federated Learning NIPS 2022
Respecting Transfer Gap in Knowledge Distillation NIPS 2022
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NIPS 2022
Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models NIPS 2022
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching NIPS 2022
Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NIPS 2022
Efficient Scheduling of Data Augmentation for Deep Reinforcement Learning NIPS 2022
Knowledge Distillation from A Stronger Teacher NIPS 2022
Distilling Representations from GAN Generator via Squeeze and Span NIPS 2022
Proper Reuse of Image Classification Features Improves Object Detection CVPR 2022
Cross-Image Relational Knowledge Distillation for Semantic Segmentation CVPR 2022