← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Few-Shot Dataset Distillation via Translative Pre-Training ICCV 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance ICCV 2023
Distribution Shift Matters for Knowledge Distillation with Webly Collected Images ICCV 2023
Efficiently Robustify Pre-Trained Models ICCV 2023
Omnidirectional Information Gathering for Knowledge Transfer-Based Audio-Visual Navigation ICCV 2023
Heterogeneous Forgetting Compensation for Class-Incremental Learning ICCV 2023
DreamTeacher: Pretraining Image Backbones with Deep Generative Models ICCV 2023
Foreground Object Search by Distilling Composite Image Feature ICCV 2023
Cumulative Spatial Knowledge Distillation for Vision Transformers ICCV 2023
Multi-Label Knowledge Distillation ICCV 2023
Tiny Updater: Towards Efficient Neural Network-Driven Software Updating ICCV 2023
Enhancing Adversarial Robustness in Low-Label Regime via Adaptively Weighted Regularization and Knowledge Distillation ICCV 2023
Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff ICCV 2023
Self-Evolved Dynamic Expansion Model for Task-Free Continual Learning ICCV 2023
Rethinking the Role of Pre-Trained Networks in Source-Free Domain Adaptation ICCV 2023
SEFD: Learning to Distill Complex Pose and Occlusion ICCV 2023
Learning to Distill Global Representation for Sparse-View CT ICCV 2023
Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation INTERSPEECH 2023
Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation INTERSPEECH 2023
An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding INTERSPEECH 2023
Masked Modeling Duo for Speech: Specializing General-Purpose Audio Representation to Speech using Denoising Distillation INTERSPEECH 2023
On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation INTERSPEECH 2023
Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions INTERSPEECH 2023
ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023
NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS INTERSPEECH 2023