conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Revisiting Knowledge Distillation: An Inheritance and Exploration Framework CVPR 2021
Amalgamating Knowledge From Heterogeneous Graph Neural Networks CVPR 2021
Teachers Do More Than Teach: Compressing Image-to-Image Models CVPR 2021
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-Bit Neural Networks via Guided Distribution Calibration CVPR 2021
Student-Teacher Learning From Clean Inputs to Noisy Inputs CVPR 2021
Ego-Exo: Transferring Visual Representations From Third-Person to First-Person Videos CVPR 2021
Parser-Free Virtual Try-On via Distilling Appearance Flows CVPR 2021
Space-Time Distillation for Video Super-Resolution CVPR 2021
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation CVPR 2021
Layer-Wise Searching for 1-Bit Detectors CVPR 2021
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning CVPR 2021
Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021
Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading CVPR 2021
3D-to-2D Distillation for Indoor Scene Parsing CVPR 2021
Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with Unlabeled Data NIPS 2021
Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly NIPS 2021
Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object Detection NIPS 2021
Non-local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation NIPS 2021
Distilling Image Classifiers in Object Detectors NIPS 2021
Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data NIPS 2021
Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation NIPS 2021
Does Knowledge Distillation Really Work? NIPS 2021
Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NIPS 2021
Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation CORL 2021
Global explanations with decision rules: a co-learning approach UAI 2021