← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Cloud Object Detector Adaptation by Integrating Different Source Knowledge NIPS 2024
PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher NIPS 2024
Sparse High Rank Adapters NIPS 2024
KTCN: Enhancing Open-World Object Detection with Knowledge Transfer and Class-Awareness Neutralization IJCAI 2024
Resource-Aware Federated Self-Supervised Learning with Global Class Representations NIPS 2024
BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling NIPS 2024
Discrepancy and Uncertainty Aware Denoising Knowledge Distillation for Zero-Shot Cross-Lingual Named Entity Recognition AAAI 2024
Fine-Grained Distillation for Long Document Retrieval AAAI 2024
From Coarse to Fine: A Distillation Method for Fine-Grained Emotion-Causal Span Pair Extraction in Conversation AAAI 2024
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams NIPS 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models ACL 2024
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation CVPR 2024
Building Vision-Language Models on Solid Foundations with Masked Distillation CVPR 2024
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models CVPR 2024
Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels CVPR 2024
PELA: Learning Parameter-Efficient Models with Low-Rank Approximation CVPR 2024
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline CVPR 2024
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning WACV 2024
Amalgamating Multi-Task Models with Heterogeneous Architectures AAAI 2024
D^4: Dataset Distillation via Disentangled Diffusion Model CVPR 2024
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024
Continual Learning with Semi-supervised Contrastive Distillation for Incremental Neural Machine Translation ACL 2024
Plug-and-Play Diffusion Distillation CVPR 2024