Knowledge Distillation

Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024 Distilling Semantic Priors from SAM to Efficient Image Restoration Models CVPR 2024 Distilling Vision-Language Models on Millions of Videos CVPR 2024 DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models ACL 2024 DistilVPR: Cross-Modal Knowledge Distillation for Visual Place Recognition AAAI 2024 DI-V2X: Learning Domain-Invariant Representation for Vehicle-Infrastructure Collaborative 3D Object Detection AAAI 2024 Divide-or-Conquer? Which Part Should You Distill Your LLM? EMNLP 2024 DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models EMNLP 2024 Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation ACL 2024 Dual-Space Knowledge Distillation for Large Language Models EMNLP 2024 Dual-teacher Knowledge Distillation for Low-frequency Word Translation EMNLP 2024 Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning AAAI 2024 EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies WACV 2024 Efficient Dataset Distillation via Minimax Diffusion CVPR 2024 Efficient Multi-task LLM Quantization and Serving for Multiple LoRA Adapters NeurIPS 2024 Efficient Stitchable Task Adaptation CVPR 2024 ELAD: Explanation-Guided Large Language Models Active Distillation ACL 2024 EM Distillation for One-step Diffusion Models NeurIPS 2024 Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study ACL 2024 Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages ACL 2024 Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic EMNLP 2024 EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NeurIPS 2024 EPSD: Early Pruning with Self-Distillation for Efficient Model Compression AAAI 2024 Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline CVPR 2024 Evolutionary Contrastive Distillation for Language Model Alignment EMNLP 2024