← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM NIPS 2021
Object DGCNN: 3D Object Detection using Dynamic Graphs NIPS 2021
Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation NAACL 2021
Self-training Improves Pre-training for Natural Language Understanding NAACL 2021
KiloNeRF: Speeding Up Neural Radiance Fields With Thousands of Tiny MLPs ICCV 2021
Distilling the Knowledge of Large-scale Generative Models into Retrieval Models for Efficient Open-domain Conversation EMNLP 2021
Voice Activity Detection with Teacher-Student Domain Emulation INTERSPEECH 2021
Matching Distributions between Model and Data: Cross-domain Knowledge Distillation for Unsupervised Domain Adaptation ACL 2021
GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation EMNLP 2021
Self-Attention Based Text Knowledge Mining for Text Detection CVPR 2021
Distillation-Guided Image Inpainting ICCV 2021
Zero-Shot Adversarial Quantization CVPR 2021
Block Pruning For Faster Transformers EMNLP 2021
Students Who Study Together Learn Better: On the Importance of Collective Knowledge Distillation for Domain Transfer in Fact Verification EMNLP 2021
On Knowledge Distillation for Translating Erroneous Speech Transcriptions ACL 2021
Aligned Structured Sparsity Learning for Efficient Image Super-Resolution NIPS 2021
Selective Knowledge Distillation for Neural Machine Translation ACL 2021
Membership Privacy for Machine Learning Models Through Knowledge Transfer AAAI 2021
Semi-Supervised Knowledge Amalgamation for Sequence Classification AAAI 2021
Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer EMNLP 2021
Text Is Text, No Matter What: Unifying Text Recognition Using Knowledge Distillation ICCV 2021
FLAR: A Unified Prototype Framework for Few-Sample Lifelong Active Recognition ICCV 2021
Jointly Learning to Repair Code and Generate Commit Message EMNLP 2021
Multilingual AMR Parsing with Noisy Knowledge Distillation EMNLP 2021
SIGN: Spatial-Information Incorporated Generative Network for Generalized Zero-Shot Semantic Segmentation ICCV 2021