← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner CVPR 2021
Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation CVPR 2021
On Learning the Geodesic Path for Incremental Learning CVPR 2021
Simulating Unknown Target Models for Query-Efficient Black-Box Attacks CVPR 2021
Data-Free Model Extraction CVPR 2021
Revisiting Knowledge Distillation: An Inheritance and Exploration Framework CVPR 2021
Amalgamating Knowledge From Heterogeneous Graph Neural Networks CVPR 2021
Teachers Do More Than Teach: Compressing Image-to-Image Models CVPR 2021
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-Bit Neural Networks via Guided Distribution Calibration CVPR 2021
Student-Teacher Learning From Clean Inputs to Noisy Inputs CVPR 2021
Ego-Exo: Transferring Visual Representations From Third-Person to First-Person Videos CVPR 2021
Parser-Free Virtual Try-On via Distilling Appearance Flows CVPR 2021
Space-Time Distillation for Video Super-Resolution CVPR 2021
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation CVPR 2021
Layer-Wise Searching for 1-Bit Detectors CVPR 2021
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning CVPR 2021
Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021
Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading CVPR 2021
3D-to-2D Distillation for Indoor Scene Parsing CVPR 2021
Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with Unlabeled Data NIPS 2021
Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly NIPS 2021
Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object Detection NIPS 2021
Non-local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation NIPS 2021
Distilling Image Classifiers in Object Detectors NIPS 2021
Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data NIPS 2021