← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Zoo-Tuning: Adaptive Transfer from A Zoo of Models ICML 2021
Learning Light-Weight Translation Models from Deep Transformer AAAI 2021
Future-Guided Incremental Transformer for Simultaneous Translation AAAI 2021
Collaborative Group Learning AAAI 2021
Invariant Teacher and Equivariant Student for Unsupervised 3D Human Pose Estimation AAAI 2021
Self-boosting for Feature Distillation IJCAI 2021
Hierarchical Self-supervised Augmented Knowledge Distillation IJCAI 2021
Federated Model Distillation with Noise-Free Differential Privacy IJCAI 2021
On Self-Distilling Graph Neural Network IJCAI 2021
Graph-Free Knowledge Distillation for Graph Neural Networks IJCAI 2021
KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation IJCAI 2021
Learning Student Networks in the Wild CVPR 2021
Distilling Object Detectors via Decoupled Features CVPR 2021
Positive-Unlabeled Data Purification in the Wild for Object Detection CVPR 2021
Three Ways To Improve Semantic Segmentation With Self-Supervised Depth Estimation CVPR 2021
CapsuleRRT: Relationships-Aware Regression Tracking via Capsules CVPR 2021
Content-Aware GAN Compression CVPR 2021
Training Generative Adversarial Networks in One Stage CVPR 2021
PLOP: Learning Without Forgetting for Continual Semantic Segmentation CVPR 2021
Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021
When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks CVPR 2021
Sequential Graph Convolutional Network for Active Learning CVPR 2021
Distilling Knowledge via Knowledge Review CVPR 2021
Semi-Supervised Domain Adaptation Based on Dual-Level Domain Mixing for Semantic Segmentation CVPR 2021
Distilling Causal Effect of Data in Class-Incremental Learning CVPR 2021