← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation ACL 2023
GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023
Curriculum Temperature for Knowledge Distillation AAAI 2023
Coaching a Teachable Student CVPR 2023
A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation ICCV 2023
Semi-Supervised Learning via Weight-Aware Distillation under Class Distribution Mismatch ICCV 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023
Self-Supervised Character-to-Character Distillation for Text Recognition ICCV 2023
StructVPR: Distill Structural Knowledge With Weighting Samples for Visual Place Recognition CVPR 2023
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation CVPR 2023
An Ensemble Distillation Framework for Sentence Embeddings with Multilingual Round-Trip Translation AAAI 2023
Co-Training 2L Submodels for Visual Recognition CVPR 2023
Cross-Modal Distillation for Speaker Recognition AAAI 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023
Semantic Scene Completion With Cleaner Self CVPR 2023
T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023
Learn More for Food Recognition via Progressive Self-Distillation AAAI 2023
Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023
Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023
MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition AAAI 2023
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs ICML 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023
Auxiliary Modality Learning with Generalized Curriculum Distillation ICML 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023