← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation CVPR 2020
Learning Voice Representation Using Knowledge Distillation for Automatic Voice Casting INTERSPEECH 2020
Intra-Utterance Similarity Preserving Knowledge Distillation for Audio Tagging INTERSPEECH 2020
SAM: Squeeze-and-Mimic Networks for Conditional Visual Driving Policy Learning CORL 2020
DFQF: Data Free Quantization-aware Fine-tuning ACML 2020
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification Using Pre-trained Language Models SEMEVAL 2020
BhamNLP at SemEval-2020 Task 12: An Ensemble of Different Word Embeddings and Emotion Transfer Learning for Arabic Offensive Language Identification in Social Media SEMEVAL 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020
BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover’s Distance EMNLP 2020
Self-Distillation Amplifies Regularization in Hilbert Space NIPS 2020
Feature-map-level Online Adversarial Knowledge Distillation ICML 2020
DVERGE: Diversifying Vulnerabilities for Enhanced Robust Generation of Ensembles NIPS 2020
Secretary and Online Matching Problems with Machine Learned Advice NIPS 2020
Combining Sequence Distillation and Transfer Learning for Efficient Low-Resource Neural Machine Translation Models EMNLP 2020
Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP 2020
Autoregressive Knowledge Distillation through Imitation Learning EMNLP 2020
Task-Oriented Feature Distillation NIPS 2020
Kungfupanda at SemEval-2020 Task 12: BERT-Based Multi-TaskLearning for Offensive Language Detection COLING 2020
What It Thinks Is Important Is Important: Robustness Transfers Through Input Gradients CVPR 2020
Open-Set Short Utterance Forensic Speaker Verification Using Teacher-Student Network with Explicit Inductive Bias INTERSPEECH 2020
Distilling Image Dehazing With Heterogeneous Task Imitation CVPR 2020
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search IJCAI 2020
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher NIPS 2020
CORAL-DMOEA: Correlation Alignment-Based Information Transfer for Dynamic Multi-Objective Optimization (Student Abstract) AAAI 2020
Inter-Region Affinity Distillation for Road Marking Segmentation CVPR 2020