conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Learning to Distill Convolutional Features Into Compact Local Descriptors WACV 2021
Adaptive Multiplane Image Generation From a Single Internet Picture WACV 2021
Real-Time Uncertainty Estimation in Computer Vision via Uncertainty-Aware Distribution Distillation WACV 2021
Data-Free Knowledge Distillation for Object Detection WACV 2021
Multi-Task Knowledge Distillation for Eye Disease Prediction WACV 2021
Distillation Multiple Choice Learning for Multimodal Action Recognition WACV 2021
Multi-Path Neural Networks for On-Device Multi-Domain Visual Classification WACV 2021
PNPDet: Efficient Few-Shot Detection Without Forgetting via Plug-and-Play Sub-Networks WACV 2021
The Curious Case of Hallucinations in Neural Machine Translation NAACL 2021
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation NAACL 2021
Multi-Grained Knowledge Distillation for Named Entity Recognition NAACL 2021
Sampling and Filtering of Neural Machine Translation Distillation Data NAACL 2021
Cost-effective Deployment of BERT Models in Serverless Environment NAACL 2021
Data and Model Distillation as a Solution for Domain-transferable Fact Verification NAACL 2021
Modality-specific Distillation NAACL 2021
KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation ICML 2021
Training data-efficient image transformers & distillation through attention ICML 2021
Simultaneous Similarity-based Self-Distillation for Deep Metric Learning ICML 2021
Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model ICML 2021
A statistical perspective on distillation ICML 2021
A Discriminative Technique for Multiple-Source Adaptation ICML 2021
Interpreting and Disentangling Feature Components of Various Complexity from DNNs ICML 2021
Towards Compact Single Image Super-Resolution via Contrastive Self-distillation IJCAI 2021
AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression IJCAI 2021
Automatic Mixed-Precision Quantization Search of BERT IJCAI 2021