← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

The Mininglamp Machine Translation System for WMT21 EMNLP 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor ACL 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network ACL 2021
Teachers Do More Than Teach: Compressing Image-to-Image Models CVPR 2021
Multi-Scale Aligned Distillation for Low-Resolution Detection CVPR 2021
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning CVPR 2021
Distilling Object Detectors via Decoupled Features CVPR 2021
PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive Learning AAAI 2021
Progressive Network Grafting for Few-Shot Knowledge Distillation AAAI 2021
Robust Knowledge Transfer via Hybrid Forward on the Teacher-Student Model AAAI 2021
SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation AAAI 2021
Towards Faster Deep Collaborative Filtering via Hierarchical Decision Networks AAAI 2021
Robust Model Compression Using Deep Hypotheses AAAI 2021
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks AAAI 2021
Knowledge Refinery: Learning from Decoupled Label AAAI 2021
Learning to Augment for Data-scarce Domain BERT Knowledge Distillation AAAI 2021
Collaborative Group Learning AAAI 2021
Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network AAAI 2021
Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network AAAI 2021
Peer Collaborative Learning for Online Knowledge Distillation AAAI 2021
A Student-Teacher Architecture for Dialog Domain Adaptation Under the Meta-Learning Setting AAAI 2021
Improving Tree-Structured Decoder Training for Code Generation via Mutual Learning AAAI 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation ACL 2021