← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

MobileVOS: Real-Time Video Object Segmentation Contrastive Learning Meets Knowledge Distillation CVPR 2023
Architecture, Dataset and Model-Scale Agnostic Data-Free Meta-Learning CVPR 2023
Generalization Matters: Loss Minima Flattening via Parameter Hybridization for Efficient Online Knowledge Distillation CVPR 2023
DisWOT: Student Architecture Search for Distillation WithOut Training CVPR 2023
Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training CVPR 2023
Decentralized Learning With Multi-Headed Distillation CVPR 2023
PartManip: Learning Cross-Category Generalizable Part Manipulation Policy From Point Cloud Observations CVPR 2023
Are Large Kernels Better Teachers than Transformers for ConvNets? ICML 2023
Random Teachers are Good Teachers ICML 2023
NTK-approximating MLP Fusion for Efficient Language Model Fine-tuning ICML 2023
Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation ICML 2023
On the Impact of Knowledge Distillation for Model Interpretability ICML 2023
Learning to Learn from APIs: Black-Box Data-Free Meta-Learning ICML 2023
Task-Specific Skill Localization in Fine-tuned Language Models ICML 2023
CocktailSGD: Fine-tuning Foundation Models over 500Mbps Networks ICML 2023
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion ICML 2023
Models Teaching Models: Improving Model Accuracy with Slingshot Learning EACL 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation EACL 2023
A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers JMLR 2023
Large-to-Small Image Resolution Asymmetry in Deep Metric Learning WACV 2023
GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023
On the Fairness Impacts of Private Ensembles Models IJCAI 2023
Model Conversion via Differentially Private Data-Free Distillation IJCAI 2023
A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation ICCV 2023