conftrace_
← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

3,086 papers

Papers per year

1
1
1
200
658
'00
'10
'15
'20
'25

Papers

Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NIPS 2023
Does Graph Distillation See Like Vision Dataset Counterpart? NIPS 2023
Multi-Head Adapter Routing for Cross-Task Generalization NIPS 2023
MixFormerV2: Efficient Fully Transformer Tracking NIPS 2023
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer NIPS 2023
Learning From Biased Soft Labels NIPS 2023
FedFed: Feature Distillation against Data Heterogeneity in Federated Learning NIPS 2023
On the Size and Approximation Error of Distilled Datasets NIPS 2023
Knowledge Diffusion for Distillation NIPS 2023
KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs NIPS 2023
Module-wise Adaptive Distillation for Multimodality Foundation Models NIPS 2023
Knowledge Distillation Performs Partial Variance Reduction NIPS 2023
Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels NIPS 2023
Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models NIPS 2023
Metis: Understanding and Enhancing In-Network Regular Expressions NIPS 2023
Should Under-parameterized Student Networks Copy or Average Teacher Weights? NIPS 2023
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NIPS 2023
Fair Graph Distillation NIPS 2023
DROID: Learning from Offline Heterogeneous Demonstrations via Reward-Policy Distillation CORL 2023
ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation CORL 2023
One Is All: Bridging the Gap between Neural Radiance Fields Architectures with Progressive Volume Distillation AAAI 2023
Parameter-Efficient Model Adaptation for Vision Transformers AAAI 2023
Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning AAAI 2023
Semi-attention Partition for Occluded Person Re-identification AAAI 2023
Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from a Conditional Causal Perspective AAAI 2023