← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022
Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal ACL 2022
Low Resource Causal Event Detection from Biomedical Literature ACL 2022
Model Distillation for Faithful Explanations of Medical Code Predictions ACL 2022
BiT: Robustly Binarized Multi-distilled Transformer NIPS 2022
Respecting Transfer Gap in Knowledge Distillation NIPS 2022
Pretrained Speech Encoders and Efficient Fine-tuning Methods for Speech Translation: UPC at IWSLT 2022 ACL 2022
Knowledge Distillation Meets Few-Shot Learning: An Approach for Few-Shot Intent Classification Within and Across Domains ACL 2022
Regularizing Brain Age Prediction via Gated Knowledge Distillation MIDL 2022
Meta-Learning Adaptive Knowledge Distillation for Efficient Biomedical Natural Language Processing AACL 2022
Modularity through Attention: Efficient Training and Transfer of Language-Conditioned Policies for Robot Manipulation CORL 2022
Self-distribution distillation: efficient uncertainty estimation UAI 2022
DiPCAN: Distilling Privileged Information for Crowd-Aware Navigation RSS 2022
Plug and Play Knowledge Distillation for kNN-LM with External Logits AACL 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks AACL 2022
Post-Training with Interrogative Sentences for Enhancing BART-based Korean Question Generator AACL 2022
Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations AACL 2022
Distill The Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation EMNLP 2022
Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model EMNLP 2022
Sparse Teachers Can Be Dense with Knowledge EMNLP 2022
Evaluating Parameter Efficient Learning for Generation EMNLP 2022
Wider & Closer: Mixture of Short-channel Distillers for Zero-shot Cross-lingual Named Entity Recognition EMNLP 2022
Spatial-Channel Token Distillation for Vision MLPs ICML 2022
Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation EMNLP 2022
TSPipe: Learn from Teacher Faster with Pipelines ICML 2022