← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding ACL 2024
AraCLIP: Cross-Lingual Learning for Effective Arabic Image Retrieval ACL 2024
Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024
Offline-to-Online Knowledge Distillation for Video Instance Segmentation WACV 2024
Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever ACL 2024
ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models ACL 2024
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis CVPR 2024
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment ACL 2024
Distilling Semantic Priors from SAM to Efficient Image Restoration Models CVPR 2024
Knowledge-Preserving Pluggable Modules for Multilingual Speech Translation Tasks INTERSPEECH 2024
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment ACL 2024
CrossKD: Cross-Head Knowledge Distillation for Object Detection CVPR 2024
DIOD: Self-Distillation Meets Object Discovery CVPR 2024
SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation CVPR 2024
Balancing Speciality and Versatility: a Coarse to Fine Framework for Supervised Fine-tuning Large Language Model ACL 2024
Learning Continual Compatible Representation for Re-indexing Free Lifelong Person Re-identification CVPR 2024
SDNet: An Extremely Efficient Portrait Matting Model via Self-Distillation WACV 2024
Gradient-Guided Knowledge Distillation for Object Detectors WACV 2024
Reverse Knowledge Distillation: Training a Large Model Using a Small One for Retinal Image Matching on Limited Data WACV 2024
Frequency Attention for Knowledge Distillation WACV 2024
GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024
Three Pillars Improving Vision Foundation Model Distillation for Lidar CVPR 2024
Improved Distribution Matching Distillation for Fast Image Synthesis NIPS 2024
Distillation Enhanced Generative Retrieval ACL 2024