← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Predicting Prerequisite Relations for Unseen Concepts EMNLP 2022
CN-AutoMIC: Distilling Chinese Commonsense Knowledge from Pretrained Language Models EMNLP 2022
Calibrating Student Models for Emotion-related Tasks EMNLP 2022
Knowledge Transfer from Answer Ranking to Answer Generation EMNLP 2022
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation EMNLP 2022
Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model EMNLP 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing EMNLP 2022
BMCook: A Task-agnostic Compression Toolkit for Big Models EMNLP 2022
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022
Distilling Multilingual Transformers into CNNs for Scalable Intent Classification EMNLP 2022
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation EMNLP 2022
From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models EMNLP 2022
ConGen: Unsupervised Control and Generalization Distillation For Sentence Representation EMNLP 2022
SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation EMNLP 2022
Class Incremental Learning for Intent Classification with Limited or No Old Data EMNLP 2022
Samsung R&D Institute Poland Participation in WMT 2022 EMNLP 2022
HW-TSC’s Submission for the WMT22 Efficiency Task EMNLP 2022
ADD: Frequency Attention and Multi-View Based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images AAAI 2022
Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation AAAI 2022
Multi-Knowledge Aggregation and Transfer for Semantic Segmentation AAAI 2022
Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022
Contact-Distil: Boosting Low Homologous Protein Contact Map Prediction by Self-Supervised Distillation AAAI 2022
Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay AAAI 2022
Label Hallucination for Few-Shot Classification AAAI 2022
TrustAL: Trustworthy Active Learning Using Knowledge Distillation AAAI 2022