← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Content-Variant Reference Image Quality Assessment via Knowledge Distillation AAAI 2022
LGD: Label-Guided Self-Distillation for Object Detection AAAI 2022
Language Modelling via Learning to Rank AAAI 2022
Knowledge Sharing via Domain Adaptation in Customs Fraud Detection AAAI 2022
bert2BERT: Towards Reusable Pretrained Language Models ACL 2022
Multi-Level Branched Regularization for Federated Learning ICML 2022
Adversarial Knowledge Distillation For Robust Spoken Language Understanding INTERSPEECH 2022
Device-Directed Speech Detection: Regularization via Distillation for Weakly-Supervised Models INTERSPEECH 2022
Bunched LPCNet2: Efficient Neural Vocoders Covering Devices from Cloud to Edge INTERSPEECH 2022
TRILLsson: Distilled Universal Paralinguistic Speech Representations INTERSPEECH 2022
Cosine Model Watermarking against Ensemble Distillation AAAI 2022
Class-Wise Adaptive Self Distillation for Federated Learning on Non-IID Data (Student Abstract) AAAI 2022
EasySED: Trusted Sound Event Detection with Self-Distillation AAAI 2022
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference ACL 2022
The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022 ACL 2022
Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injection ACL 2022
Efficient Hyper-parameter Search for Knowledge Graph Embedding ACL 2022
Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation ACL 2022
Distillation of RL Policies with Formal Guarantees via Variational Abstraction of Markov Decision Processes AAAI 2022
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization ACL 2022
The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022
DocInfer: Document-level Natural Language Inference using Optimal Evidence Selection EMNLP 2022
Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment Analysis EMNLP 2022
VIRT: Improving Representation-based Text Matching via Virtual Interaction EMNLP 2022
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022