← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation INTERSPEECH 2021
Contrastive Model Invertion for Data-Free Knolwedge Distillation IJCAI 2021
A Hands-On Comparison of DNNs for Dialog Separation Using Transfer Learning from Music Source Separation INTERSPEECH 2021
REPAINT: Knowledge Transfer in Deep Reinforcement Learning ICML 2021
Zoo-Tuning: Adaptive Transfer from A Zoo of Models ICML 2021
Towards Learning Spatially Discriminative Feature Representations ICCV 2021
Boosting Weakly Supervised Object Detection via Learning Bounding Box Adjusters ICCV 2021
Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning ICCV 2021
Multimodal Knowledge Expansion ICCV 2021
Student Customized Knowledge Distillation: Bridging the Gap Between Student and Teacher ICCV 2021
Learning an Augmented RGB Representation With Cross-Modal Knowledge Distillation for Action Detection ICCV 2021
Active Learning for Lane Detection: A Knowledge Distillation Approach ICCV 2021
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains ACL 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor ACL 2021
Diverse Knowledge Distillation for End-to-End Person Search AAAI 2021
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism ACL 2021
Learning to Reweight with Deep Interactions AAAI 2021
Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- and Intra-modality Attention AAAI 2021
ALP-KD: Attention-Based Layer Projection for Knowledge Distillation AAAI 2021
Deep Structured Instance Graph for Distilling Object Detectors ICCV 2021
Learning Compatible Embeddings ICCV 2021
Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognition ICCV 2021
Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic Segmentation ICCV 2021
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment ICCV 2021