Knowledge Distillation

Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024 Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation CVPR 2024 Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024 Distilling Knowledge from Text-to-Image Generative Models Improves Visio-Linguistic Reasoning in CLIP EMNLP 2024 Distilling ODE Solvers of Diffusion Models into Smaller Steps CVPR 2024 Distilling Reliable Knowledge for Instance-Dependent Partial Label Learning AAAI 2024 Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation ACL 2024 Distilling Semantic Priors from SAM to Efficient Image Restoration Models CVPR 2024 Distilling Text Style Transfer With Self-Explanation From LLMs NAACL 2024 Distilling Vision-Language Models on Millions of Videos CVPR 2024 DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models ACL 2024 DistillSpec: Improving Speculative Decoding via Knowledge Distillation ICLR 2024 DistilVPR: Cross-Modal Knowledge Distillation for Visual Place Recognition AAAI 2024 Distribution-aware Knowledge Prototyping for Non-exemplar Lifelong Person Re-identification CVPR 2024 DI-V2X: Learning Domain-Invariant Representation for Vehicle-Infrastructure Collaborative 3D Object Detection AAAI 2024 Divide-or-Conquer? Which Part Should You Distill Your LLM? EMNLP 2024 DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model EMNLP 2024 DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling ACL 2024 DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models EMNLP 2024 Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations? EMNLP 2024 Domain Adaptation for Large-Vocabulary Object Detectors NeurIPS 2024 Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation ACL 2024 Do You Remember the Future? Weak-to-Strong Generalization in 3D Object Detection IJCAI 2024 Dual Expert Distillation Network for Generalized Zero-Shot Learning IJCAI 2024 Dual-Perspective Knowledge Enrichment for Semi-supervised 3D Object Detection AAAI 2024