← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Rethinking Data-Free Quantization as a Zero-Sum Game AAAI 2023
Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023
Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems AAAI 2023
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023
A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models ACL 2023
Cost-effective Distillation of Large Language Models ACL 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023
Better Simultaneous Translation with Monotonic Knowledge Distillation ACL 2023
DISCO: Distilling Counterfactuals with Large Language Models ACL 2023
Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection AAAI 2023
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation AAAI 2023
StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-Based 3D Object Detection AAAI 2023
Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023
Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023
Curriculum Temperature for Knowledge Distillation AAAI 2023
MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition AAAI 2023
Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from a Conditional Causal Perspective AAAI 2023
Semi-attention Partition for Occluded Person Re-identification AAAI 2023
Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding INTERSPEECH 2023
Compressed MoE ASR Model Based on Knowledge Distillation and Quantization INTERSPEECH 2023
Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding INTERSPEECH 2023
An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition INTERSPEECH 2023
SCOTT: Self-Consistent Chain-of-Thought Distillation ACL 2023