← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition ACL 2022
Static-Dynamic Co-teaching for Class-Incremental 3D Object Detection AAAI 2022
A Self-improving Skin Lesions Diagnosis Framework Via Pseudo-labeling and Self-distillation ACML 2022
Towards Data-Free Domain Generalization ACML 2022
Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model EMNLP 2022
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation EMNLP 2022
Class-Wise Adaptive Self Distillation for Federated Learning on Non-IID Data (Student Abstract) AAAI 2022
Calibrating Student Models for Emotion-related Tasks EMNLP 2022
CN-AutoMIC: Distilling Chinese Commonsense Knowledge from Pretrained Language Models EMNLP 2022
Distilled Dual-Encoder Model for Vision-Language Understanding EMNLP 2022
ConNER: Consistency Training for Cross-lingual Named Entity Recognition EMNLP 2022
Occlusion Resistant Network for 3D Face Reconstruction WACV 2022
Unifying the Convergences in Multilingual Neural Machine Translation EMNLP 2022
Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation EMNLP 2022
Improved Feature Distillation via Projector Ensemble NIPS 2022
ConGen: Unsupervised Control and Generalization Distillation For Sentence Representation EMNLP 2022
SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation EMNLP 2022
Bridging Fairness and Environmental Sustainability in Natural Language Processing EMNLP 2022
Cross-Layer Similarity Knowledge Distillation for Speech Enhancement INTERSPEECH 2022
Model Compression by Iterative Pruning with Knowledge Distillation and Its Application to Speech Enhancement INTERSPEECH 2022
Self-Distillation Based on High-level Information Supervision for Compressing End-to-End ASR Model INTERSPEECH 2022
Learn What Is Possible, Then Choose What Is Best: Disentangling One-To-Many Relations in Language Through Text-based Games EMNLP 2022
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models EMNLP 2022
Semi-Supervised Lifelong Language Learning EMNLP 2022
Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages EMNLP 2022