← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022
Ensembling Off-the-Shelf Models for GAN Training CVPR 2022
Pre-Train, Self-Train, Distill: A Simple Recipe for Supersizing 3D Reconstruction CVPR 2022
Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation CVPR 2022
Decoupled Knowledge Distillation CVPR 2022
DNA: Proximal Policy Optimization with a Dual Network Architecture NIPS 2022
Symbolic Distillation for Learned TCP Congestion Control NIPS 2022
Meta-Learning with Self-Improving Momentum Target NIPS 2022
Offline Multi-Agent Reinforcement Learning with Knowledge Distillation NIPS 2022
Contextual Similarity Distillation for Asymmetric Image Retrieval CVPR 2022
Training Spiking Neural Networks with Local Tandem Learning NIPS 2022
Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks NIPS 2022
Weighted Mutual Learning with Diversity-Driven Model Compression NIPS 2022
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
Discovering and Overcoming Limitations of Noise-engineered Data-free Knowledge Distillation NIPS 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems EMNLP 2022
ZeroGen: Efficient Zero-shot Learning via Dataset Generation EMNLP 2022
Fixing Model Bugs with Natural Language Patches EMNLP 2022
Rethinking Task-Specific Knowledge Distillation: Contextualized Corpus as Better Textbook EMNLP 2022
Graphein - a Python Library for Geometric Deep Learning and Network Analysis on Biomolecular Structures and Interaction Networks NIPS 2022
BNS: Building Network Structures Dynamically for Continual Learning NIPS 2021
Parameterized Knowledge Transfer for Personalized Federated Learning NIPS 2021
Dynamic Knowledge Distillation for Pre-trained Language Models EMNLP 2021
Multi-Vector Attention Models for Deep Re-ranking EMNLP 2021