← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

M2SD:Multiple Mixing Self-Distillation for Few-Shot Class-Incremental Learning AAAI 2024
Impartial Adversarial Distillation: Addressing Biased Data-Free Knowledge Distillation via Adaptive Constrained Optimization AAAI 2024
IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation CVPR 2024
Direct May Not Be the Best: An Incremental Evolution View of Pose Generation AAAI 2024
DI-V2X: Learning Domain-Invariant Representation for Vehicle-Infrastructure Collaborative 3D Object Detection AAAI 2024
Expediting Contrastive Language-Image Pretraining via Self-Distilled Encoders AAAI 2024
A Dynamic GCN with Cross-Representation Distillation for Event-Based Learning AAAI 2024
VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models EMNLP 2024
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic ACL 2024
Omnipotent Distillation with LLMs for Weakly-Supervised Natural Language Video Localization: When Divergence Meets Consistency AAAI 2024
Local-Global Multi-Modal Distillation for Weakly-Supervised Temporal Video Grounding AAAI 2024
LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives EMNLP 2024
Bootstrapping Cognitive Agents with a Large Language Model AAAI 2024
An Empirical Study of Multilingual Reasoning Distillation for Question Answering EMNLP 2024
iKUN: Speak to Trackers without Retraining CVPR 2024
Three Pillars Improving Vision Foundation Model Distillation for Lidar CVPR 2024
Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline CVPR 2024
Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios CVPR 2024
Holistic Features are almost Sufficient for Text-to-Video Retrieval CVPR 2024
Distilling Vision-Language Models on Millions of Videos CVPR 2024
Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue EMNLP 2024
Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding ACL 2024
ScaleKD: Strong Vision Transformers Could Be Excellent Teachers NIPS 2024