← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization EMNLP 2022
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings EMNLP 2022
TransAdv: A Translation-based Adversarial Learning Framework for Zero-Resource Cross-Lingual Named Entity Recognition EMNLP 2022
Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search EMNLP 2022
Predicting Prerequisite Relations for Unseen Concepts EMNLP 2022
Boosting 3D Object Detection by Simulating Multimodality on Point Clouds CVPR 2022
Proper Reuse of Image Classification Features Improves Object Detection CVPR 2022
Localization Distillation for Dense Object Detection CVPR 2022
Cross-Image Relational Knowledge Distillation for Semantic Segmentation CVPR 2022
Scale-Equivalent Distillation for Semi-Supervised Object Detection CVPR 2022
Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation CVPR 2022
Cross Domain Object Detection by Target-Perceived Dual Branch Distillation CVPR 2022
Let Images Give You More: Point Cloud Cross-Modal Training for Shape Analysis NIPS 2022
FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Models INTERSPEECH 2022
Self-distribution distillation: efficient uncertainty estimation UAI 2022
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching NIPS 2022
Towards Efficient 3D Object Detection with Knowledge Distillation NIPS 2022
Outsourcing Training without Uploading Data via Efficient Collaborative Open-Source Sampling NIPS 2022
E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition CVPR 2022
DENSE: Data-Free One-Shot Federated Learning NIPS 2022
Knowledge Distillation: Bad Models Can Be Good Role Models NIPS 2022
FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction NIPS 2022
Self-paced Supervision for Multi-source Domain Adaptation IJCAI 2022
Learn From Others and Be Yourself in Heterogeneous Federated Learning CVPR 2022
Learning Structured Gaussians To Approximate Deep Ensembles CVPR 2022