← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Data-Free Knowledge Distillation for Image Super-Resolution CVPR 2021
Probabilistic Model Distillation for Semantic Correspondence CVPR 2021
Delving into Data: Effectively Substitute Training for Black-box Attack CVPR 2021
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification CVPR 2021
Compatibility-Aware Heterogeneous Visual Search CVPR 2021
Positive-Congruent Training: Towards Regression-Free Model Updates CVPR 2021
Knowledge Evolution in Neural Networks CVPR 2021
Meta Pseudo Labels CVPR 2021
Diversity Matters When Learning From Ensembles NIPS 2021
POS-Constrained Parallel Decoding for Non-autoregressive Generation ACL 2021
Learning to Explain: Generating Stable Explanations Fast ACL 2021
Tree-Like Decision Distillation CVPR 2021
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 ACL 2021
Obtaining Better Static Word Embeddings Using Contextual Embedding Models ACL 2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021
Weight Distillation: Transferring the Knowledge in Neural Network Parameters ACL 2021
Flexible Non-Autoregressive Extractive Summarization with Threshold: How to Extract a Non-Fixed Number of Summary Sentences AAAI 2021
Anomaly Detection in Video via Self-Supervised and Multi-Task Learning CVPR 2021
VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer NIPS 2021
Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework NIPS 2021
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation CVPR 2021
An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation IJCNLP 2021
Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer ICCV 2021
Learning Student-Friendly Teacher Networks for Knowledge Distillation NIPS 2021
Exploring Non-Autoregressive Text Style Transfer EMNLP 2021