← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Knowledge Distillation for End-to-End Monaural Multi-Talker ASR System INTERSPEECH 2019
Baidu Neural Machine Translation Systems for WMT19 ACL 2019
Scalable Syntax-Aware Language Models Using Knowledge Distillation ACL 2019
Knowledge Distillation for Throat Microphone Speech Recognition INTERSPEECH 2019
Progressive Blockwise Knowledge Distillation for Neural Network Acceleration IJCAI 2018
XL-NBT: A Cross-lingual Neural Belief Tracking Framework EMNLP 2018
Knowledge Distillation for Sequence Model INTERSPEECH 2018
Improving DNNs Trained with Non-Native Transcriptions Using Knowledge Distillation and Target Interpolation INTERSPEECH 2018
Attention-Guided Answer Distillation for Machine Reading Comprehension EMNLP 2018
PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing CVPR 2018
Teaching Semi-Supervised Classifier via Generalized Distillation IJCAI 2018
Deep k-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutions ICML 2018
Compression of End-to-End Models INTERSPEECH 2018
Generative Bridging Network for Neural Sequence Prediction NAACL 2018
Representation Learning on Graphs with Jumping Knowledge Networks ICML 2018
Deep Mutual Learning CVPR 2018
Empirical Analysis of Score Fusion Application to Combined Neural Networks for Open Vocabulary Spoken Term Detection INTERSPEECH 2018
Progress & Compress: A scalable framework for continual learning ICML 2018
Revisiting the Importance of Encoding Logic Rules in Sentiment Classification EMNLP 2018
StrassenNets: Deep Learning with a Multiplication Budget ICML 2018
Better and Faster: Knowledge Transfer from Multiple Self-supervised Learning Tasks via Graph Distillation for Video Classification IJCAI 2018
Born Again Neural Networks ICML 2018
Feature Representation of Short Utterances Based on Knowledge Distillation for Spoken Language Identification INTERSPEECH 2018
Knowledge Transfer with Jacobian Matching ICML 2018
Cooperative Denoising for Distantly Supervised Relation Extraction COLING 2018