← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training CVPR 2023
Adaptive Data-Free Quantization CVPR 2023
Decomposed Cross-Modal Distillation for RGB-Based Temporal Action Detection CVPR 2023
OvarNet: Towards Open-Vocabulary Object Attribute Recognition CVPR 2023
Generalization Matters: Loss Minima Flattening via Parameter Hybridization for Efficient Online Knowledge Distillation CVPR 2023
Supervised Masked Knowledge Distillation for Few-Shot Transformers CVPR 2023
Decentralized Learning With Multi-Headed Distillation CVPR 2023
Constructing Deep Spiking Neural Networks From Artificial Neural Networks With Knowledge Distillation CVPR 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
Models Teaching Models: Improving Model Accuracy with Slingshot Learning EACL 2023
On the Impact of Knowledge Distillation for Model Interpretability ICML 2023
Understanding the Distillation Process from Deep Generative Models to Tractable Probabilistic Circuits ICML 2023
STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition ICML 2023
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs ICML 2023
Protecting Language Generation Models via Invisible Watermarking ICML 2023
Bayesian Optimization Meets Self-Distillation ICCV 2023
Fine-tuning Audio Spectrogram Transformer with Task-aware Adapters for Sound Event Detection INTERSPEECH 2023
Unsupervised Adaptation with Quality-Aware Masking to Improve Target-Speaker Voice Activity Detection for Speaker Diarization INTERSPEECH 2023
A Metric-Driven Approach to Conformer Layer Pruning for Efficient ASR Inference INTERSPEECH 2023
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023
ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity Recognition AAAI 2023
KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction AAAI 2023
Learning Answer Generation using Supervision from Automatic Question Answering Evaluators ACL 2023
TempLM: Distilling Language Models into Template-Based Generators ACL 2023
Teacher and Student Models of Offensive Language in Social Media ACL 2023