← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Collaborative Learning via Prediction Consensus NIPS 2023
Localized Symbolic Knowledge Distillation for Visual Commonsense Models NIPS 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning NIPS 2023
Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks ACML 2023
Robust distillation for worst-class performance: on the interplay between teacher and student objectives UAI 2023
Logit-based ensemble distribution distillation for robust autoregressive sequence uncertainties UAI 2023
One Policy to Dress Them All: Learning to Dress People with Diverse Poses and Garments RSS 2023
MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers EACL 2023
Integrating Translation Memories into Non-Autoregressive Machine Translation EACL 2023
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding EACL 2023
MAPL: Parameter-Efficient Adaptation of Unimodal Pre-Trained Models for Vision-Language Few-Shot Prompting EACL 2023
Distillation of encoder-decoder transformers for sequence labelling EACL 2023
Do we need Label Regularization to Fine-tune Pre-trained Language Models? EACL 2023
Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings EACL 2023
Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation EACL 2023
Combining Parameter-efficient Modules for Task-level Generalisation EACL 2023
Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion EACL 2023
Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation EACL 2023
SSSD: Self-Supervised Self Distillation WACV 2023
Probabilistic Integration of Object Level Annotations in Chest X-Ray Classification WACV 2023
Few-Shot Learning of Compact Models via Task-Specific Meta Distillation WACV 2023
Adversarial Local Distribution Regularization for Knowledge Distillation WACV 2023
AttTrack: Online Deep Attention Transfer for Multi-Object Tracking WACV 2023
SALAD: Source-Free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection WACV 2023
Semantic Segmentation of Degraded Images Using Layer-Wise Feature Adjustor WACV 2023