← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation ICCV 2023
Semi-Supervised Learning via Weight-Aware Distillation under Class Distribution Mismatch ICCV 2023
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing EMNLP 2023
Self-Supervised Character-to-Character Distillation for Text Recognition ICCV 2023
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs ICML 2023
Auxiliary Modality Learning with Generalized Curriculum Distillation ICML 2023
Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining ICML 2023
Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023
Co-Training 2L Submodels for Visual Recognition CVPR 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023
Semantic Scene Completion With Cleaner Self CVPR 2023
On Distillation of Guided Diffusion Models CVPR 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023
LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing ACL 2023
Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System ACL 2023
Type Enhanced BERT for Correcting NER Errors ACL 2023
Digging out Discrimination Information from Generated Samples for Robust Visual Question Answering ACL 2023
Improving Knowledge Graph Completion with Generative Hard Negative Mining ACL 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023
f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
Local 3D Editing via 3D Distillation of CLIP Knowledge CVPR 2023
Decoupled Multimodal Distilling for Emotion Recognition CVPR 2023
KD-DLGAN: Data Limited Image Generation via Knowledge Distillation CVPR 2023