← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Linkless Link Prediction via Relational Distillation ICML 2023
Less is More: Task-aware Layer-wise Distillation for Language Model Compression ICML 2023
Understanding the Distillation Process from Deep Generative Models to Tractable Probabilistic Circuits ICML 2023
TR0N: Translator Networks for 0-Shot Plug-and-Play Conditional Generation ICML 2023
Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining ICML 2023
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs ICML 2023
Margin-based Neural Network Watermarking ICML 2023
Auxiliary Modality Learning with Generalized Curriculum Distillation ICML 2023
Fine-tuning Audio Spectrogram Transformer with Task-aware Adapters for Sound Event Detection INTERSPEECH 2023
Distilling knowledge from Gaussian process teacher to neural network student INTERSPEECH 2023
A Multiple-Teacher Pruning Based Self-Distillation (MT-PSD) Approach to Model Compression for Audio-Visual Wake Word Spotting INTERSPEECH 2023
Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding INTERSPEECH 2023
Soft Target-Enhanced Matching Framework for Deep Entity Matching AAAI 2023
T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023
Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems AAAI 2023
Learn More for Food Recognition via Progressive Self-Distillation AAAI 2023
Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023
Prompting Neural Machine Translation with Translation Memories AAAI 2023
Scalable Theory-Driven Regularization of Scene Graph Generation Models AAAI 2023
Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023
Learning from the Wisdom of Crowds: Exploiting Similar Sessions for Session Search AAAI 2023
Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning EMNLP 2023
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models EMNLP 2023
Decomposing Complex Queries for Tip-of-the-tongue Retrieval EMNLP 2023
MCC-KD: Multi-CoT Consistent Knowledge Distillation EMNLP 2023