← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data CVPR 2022
Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation CVPR 2022
Improving Video Model Transfer With Dynamic Representation Learning CVPR 2022
The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection COLING 2022
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
Representation Compensation Networks for Continual Semantic Segmentation CVPR 2022
Focal and Global Knowledge Distillation for Detectors CVPR 2022
The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes NIPS 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Incremental Cross-View Mutual Distillation for Self-Supervised Medical CT Synthesis CVPR 2022
One-Teacher and Multiple-Student Knowledge Distillation on Sentiment Classification COLING 2022
Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation COLING 2022
Section-Aware Commonsense Knowledge-Grounded Dialogue Generation with Pre-trained Language Model COLING 2022
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
Boosting Contrastive Learning with Relation Knowledge Distillation AAAI 2022
Safe Distillation Box AAAI 2022
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation NAACL 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Being Friends Instead of Adversaries: Deep Networks Learn from Data Simplified by Other Networks AAAI 2022
Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks NAACL 2022
LastResort at SemEval-2022 Task 4: Towards Patronizing and Condescending Language Detection using Pre-trained Transformer Based Models Ensembles NAACL 2022
FOCUS: Flexible Optimizable Counterfactual Explanations for Tree Ensembles AAAI 2022
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching NAACL 2022
End-to-End Simultaneous Speech Translation with Pretraining and Distillation: Huawei Noah’s System for AutoSimTranS 2022 NAACL 2022