← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data EMNLP 2024
Local-Global Multi-Modal Distillation for Weakly-Supervised Temporal Video Grounding AAAI 2024
LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives EMNLP 2024
Bootstrapping Cognitive Agents with a Large Language Model AAAI 2024
An Empirical Study of Multilingual Reasoning Distillation for Question Answering EMNLP 2024
Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024
Data-Free Quantization via Pseudo-label Filtering CVPR 2024
Teaching Small Language Models Reasoning through Counterfactual Distillation EMNLP 2024
DAdEE: Unsupervised Domain Adaptation in Early Exit PLMs EMNLP 2024
LoRA-GA: Low-Rank Adaptation with Gradient Approximation NIPS 2024
Continual Variational Autoencoder via Continual Generative Knowledge Distillation AAAI 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023
Adaptive Mixing of Auxiliary Losses in Supervised Learning AAAI 2023
DisGUIDE: Disagreement-Guided Data-Free Model Extraction AAAI 2023
Mixture Uniform Distribution Modeling and Asymmetric Mix Distillation for Class Incremental Learning AAAI 2023
Rethinking Data-Free Quantization as a Zero-Sum Game AAAI 2023
Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023
Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems AAAI 2023
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection AAAI 2023
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation AAAI 2023
StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-Based 3D Object Detection AAAI 2023
Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023
Curriculum Temperature for Knowledge Distillation AAAI 2023