← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Structure-Level Knowledge Distillation For Multilingual Sequence Labeling ACL 2020
Model Watermarking for Image Processing Networks AAAI 2020
Knowledge Distillation from Internal Representations AAAI 2020
TernaryBERT: Distillation-aware Ultra-low Bit BERT EMNLP 2020
Multi-Stage Influence Function NIPS 2020
Self-Supervised Generative Adversarial Compression NIPS 2020
Inducing Relational Knowledge from BERT AAAI 2020
High Performance Natural Language Processing EMNLP 2020
Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation From a Blackbox Model CVPR 2020
Improving Neural Topic Models using Knowledge Distillation EMNLP 2020
Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task EMNLP 2020
BPGC at SemEval-2020 Task 11: Propaganda Detection in News Articles with Multi-Granularity Knowledge Sharing and Linguistic Features Based Ensemble Learning COLING 2020
Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion NIPS 2020
Exploring the Boundaries of Low-Resource BERT Distillation EMNLP 2020
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing EMNLP 2020
DynaBERT: Dynamic BERT with Adaptive Width and Depth NIPS 2020
Incremental Event Detection via Knowledge Consolidation Networks EMNLP 2020
More Grounded Image Captioning by Distilling Image-Text Matching Model CVPR 2020
Kernel Based Progressive Distillation for Adder Neural Networks NIPS 2020
Knowledge Base Embedding By Cooperative Knowledge Distillation COLING 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline NIPS 2020
Residual Distillation: Towards Portable Deep Neural Networks without Shortcuts NIPS 2020
Reverse-engineering recurrent neural network solutions to a hierarchical inference task for mice NIPS 2020
Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch UAI 2020
Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020