← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Infusing Knowledge from Wikipedia to Enhance Stance Detection ACL 2022
X-Trans2Cap: Cross-Modal Knowledge Transfer Using Transformer for 3D Dense Captioning CVPR 2022
XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient NIPS 2022
Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes? EMNLP 2022
Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correction ACL 2022
Domain Knowledge Transferring for Pre-trained Language Model via Calibrated Activation Boundary Distillation ACL 2022
Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models EMNLP 2022
The AISP-SJTU Translation System for WMT 2022 EMNLP 2022
HW-TSC’s Submissions to the WMT 2022 General Machine Translation Shared Task EMNLP 2022
Fast Vocabulary Transfer for Language Model Compression EMNLP 2022
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022
Fine-Tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning CVPR 2022
CUNI Non-Autoregressive System for the WMT 22 Efficient Translation Shared Task EMNLP 2022
A Flexible Multi-Task Model for BERT Serving ACL 2022
Improved Feature Distillation via Projector Ensemble NIPS 2022
Bridging Fairness and Environmental Sustainability in Natural Language Processing EMNLP 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing EMNLP 2022
Up to 100x Faster Data-Free Knowledge Distillation AAAI 2022
Toward Understanding Privileged Features Distillation in Learning-to-Rank NIPS 2022
Named Entity Recognition in Industrial Tables using Tabular Language Models EMNLP 2022
An Efficient Combinatorial Optimization Model Using Learning-to-Rank Distillation AAAI 2022
SeqPATE: Differentially Private Text Generation via Knowledge Distillation NIPS 2022
Look Around and Refer: 2D Synthetic Semantics Knowledge Distillation for 3D Visual Grounding NIPS 2022
ML_LTU at SemEval-2022 Task 4: T5 Towards Identifying Patronizing and Condescending Language NAACL 2022
Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation NIPS 2022