← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

DINE: Domain Adaptation From Single and Multiple Black-Box Predictors CVPR 2022
Long-Tail Recognition via Compositional Knowledge Transfer CVPR 2022
Proto2Proto: Can You Recognize the Car, the Way I Do? CVPR 2022
Class-Incremental Learning by Knowledge Distillation With Adaptive Feature Consolidation CVPR 2022
Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning IJCAI 2022
Continual Federated Learning Based on Knowledge Distillation IJCAI 2022
Maximum Bayes Smatch Ensemble Distillation for AMR Parsing NAACL 2022
A Closer Look at Parameter Contributions When Training Neural Language and Translation Models COLING 2022
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks COLING 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
Semi-Supervised Domain Adaptation via Sample-to-Sample Self-Distillation WACV 2022
PERF-Net: Pose Empowered RGB-Flow Net WACV 2022
Extractive Knowledge Distillation WACV 2022
Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022
Outsourcing Training without Uploading Data via Efficient Collaborative Open-Source Sampling NIPS 2022
DENSE: Data-Free One-Shot Federated Learning NIPS 2022
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights NIPS 2022
Knowledge Distillation: Bad Models Can Be Good Role Models NIPS 2022
Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks NIPS 2022
MAgNet: Mesh Agnostic Neural PDE Solver NIPS 2022
Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NIPS 2022
Remember the Past: Distilling Datasets into Addressable Memories for Neural Networks NIPS 2022
Shadow Knowledge Distillation: Bridging Offline and Online Knowledge Transfer NIPS 2022
ConGen: Unsupervised Control and Generalization Distillation For Sentence Representation EMNLP 2022
Lost in Distillation: A Case Study in Toxicity Modeling NAACL 2022