← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

IterDE: An Iterative Knowledge Distillation Framework for Knowledge Graph Embeddings AAAI 2023
Pretrained Bidirectional Distillation for Machine Translation ACL 2023
Deep Model Compression Also Helps Models Capture Ambiguity ACL 2023
Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text ACL 2023
I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation ACL 2023
Dataset Distillation with Attention Labels for Fine-tuning BERT ACL 2023
Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models ACL 2023
CUPID: Curriculum Learning Based Real-Time Prediction using Distillation ACL 2023
Know Where You’re Going: Meta-Learning for Parameter-Efficient Fine-Tuning ACL 2023
Privacy-Preserving Knowledge Transfer through Partial Parameter Sharing ACL 2023
Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values ACL 2023
Recyclable Tuning for Continual Pre-training ACL 2023
Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model ACL 2023
itKD: Interchange Transfer-Based Knowledge Distillation for 3D Object Detection CVPR 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-Trained Models CVPR 2023
SCPNet: Semantic Scene Completion on Point Cloud CVPR 2023
Distilling Vision-Language Pre-Training To Collaborate With Weakly-Supervised Temporal Action Localization CVPR 2023
DaFKD: Domain-Aware Federated Knowledge Distillation CVPR 2023
Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? EMNLP 2023
MMANet: Margin-Aware Distillation and Modality-Aware Regularization for Incomplete Multimodal Learning CVPR 2023
Preserving Linear Separability in Continual Learning by Backward Feature Projection CVPR 2023
3DAvatarGAN: Bridging Domains for Personalized Editable Avatars CVPR 2023
CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models EMNLP 2023
Lion: Adversarial Distillation of Proprietary Large Language Models EMNLP 2023
DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining EMNLP 2023