← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Self-supervised Models are Good Teaching Assistants for Vision Transformers ICML 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022
Compressing Models With Few Samples: Mimicking Then Replacing CVPR 2022
Robust Cross-Modal Representation Learning With Progressive Self-Distillation CVPR 2022
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection CVPR 2022
Anomaly Detection via Reverse Distillation From One-Class Embedding CVPR 2022
Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022
PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models CVPR 2022
Low-Cost Multispectral Scene Analysis With Modality Distillation WACV 2022
Self-Guidance: Improve Deep Neural Network Generalization via Knowledge Distillation WACV 2022
Supervised Compression for Resource-Constrained Edge Computing Systems WACV 2022
Self-Supervised Knowledge Transfer via Loosely Supervised Auxiliary Tasks WACV 2022
PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression WACV 2022
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data WACV 2022
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation CVPR 2022
Boosting 3D Object Detection by Simulating Multimodality on Point Clouds CVPR 2022
Localization Distillation for Dense Object Detection CVPR 2022
Cross-Image Relational Knowledge Distillation for Semantic Segmentation CVPR 2022
Scale-Equivalent Distillation for Semi-Supervised Object Detection CVPR 2022
Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation CVPR 2022
Cross Domain Object Detection by Target-Perceived Dual Branch Distillation CVPR 2022
Improving Object Detection by Label Assignment Distillation WACV 2022
DST: Dynamic Substitute Training for Data-Free Black-Box Attack CVPR 2022
Nested Collaborative Learning for Long-Tailed Visual Recognition CVPR 2022