conftrace_
← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

3,086 papers

Papers per year

1
1
1
200
658
'00
'10
'15
'20
'25

Papers

Residual Distillation: Towards Portable Deep Neural Networks without Shortcuts NIPS 2020
DynaBERT: Dynamic BERT with Adaptive Width and Depth NIPS 2020
Kernel Based Progressive Distillation for Adder Neural Networks NIPS 2020
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space NIPS 2020
Multi-Stage Influence Function NIPS 2020
CompRess: Self-Supervised Learning by Compressing Representations NIPS 2020
Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge NIPS 2020
Task-Oriented Feature Distillation NIPS 2020
Knowledge Transfer in Multi-Task Deep Reinforcement Learning for Continuous Control NIPS 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline NIPS 2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NIPS 2020
Hybrid Models for Learning to Branch NIPS 2020
Black-Box Ripper: Copying black-box models using generative evolutionary algorithms NIPS 2020
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher NIPS 2020
Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion NIPS 2020
Distributed Distillation for On-Device Learning NIPS 2020
SAM: Squeeze-and-Mimic Networks for Conditional Visual Driving Policy Learning CORL 2020
Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge Distillation AAAI 2020
DeGAN: Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier AAAI 2020
Few Shot Network Compression via Cross Distillation AAAI 2020
Scalable Attentive Sentence Pair Modeling via Distilled Sentence Embedding AAAI 2020
Online Knowledge Distillation with Diverse Peers AAAI 2020
Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020
Adversarially Robust Distillation AAAI 2020
Robust Federated Learning via Collaborative Machine Teaching AAAI 2020