← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation EMNLP 2023
torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP EMNLP 2023
CRUSH4SQL: Collective Retrieval Using Schema Hallucination For Text2SQL EMNLP 2023
The student becomes the master: Outperforming GPT3 on Scientific Factual Error Correction EMNLP 2023
InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023
Coaching a Teachable Student CVPR 2023
Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation CVPR 2023
SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation CVPR 2023
TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NIPS 2023
Spectral Co-Distillation for Personalized Federated Learning NIPS 2023
Improving Adversarial Robustness via Information Bottleneck Distillation NIPS 2023
DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning NIPS 2023
EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding NIPS 2023
Switching Temporary Teachers for Semi-Supervised Semantic Segmentation NIPS 2023
Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NIPS 2023
Does Graph Distillation See Like Vision Dataset Counterpart? NIPS 2023
Knowledge Diffusion for Distillation NIPS 2023
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference NIPS 2023
STXD: Structural and Temporal Cross-Modal Distillation for Multi-View 3D Object Detection NIPS 2023
Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detection NIPS 2023
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference NIPS 2023
Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels NIPS 2023
Reusing Pretrained Models by Multi-linear Operators for Efficient Training NIPS 2023
MixFormerV2: Efficient Fully Transformer Tracking NIPS 2023
Knowledge Distillation Performs Partial Variance Reduction NIPS 2023