← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

DST: Dynamic Substitute Training for Data-Free Black-Box Attack CVPR 2022
Nested Collaborative Learning for Long-Tailed Visual Recognition CVPR 2022
Cross-Modal Perceptionist: Can Face Geometry Be Gleaned From Voices? CVPR 2022
Cross-Domain Correlation Distillation for Unsupervised Domain Adaptation in Nighttime Semantic Segmentation CVPR 2022
Slimmable Domain Adaptation CVPR 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data CVPR 2022
Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation CVPR 2022
Improving Video Model Transfer With Dynamic Representation Learning CVPR 2022
Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks NIPS 2022
Infinite Recommendation Networks: A Data-Centric Approach NIPS 2022
Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NIPS 2022
Distilling Inter-Class Distance for Semantic Segmentation IJCAI 2022
TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation NIPS 2022
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification NIPS 2022
Hilbert Distillation for Cross-Dimensionality Networks NIPS 2022
Label Hallucination for Few-Shot Classification AAAI 2022
Structural Knowledge Distillation for Object Detection NIPS 2022
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization ACL 2022
Being Friends Instead of Adversaries: Deep Networks Learn from Data Simplified by Other Networks AAAI 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
Representation Compensation Networks for Continual Semantic Segmentation CVPR 2022
Focal and Global Knowledge Distillation for Detectors CVPR 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Maximum Bayes Smatch Ensemble Distillation for AMR Parsing NAACL 2022