← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Lite-MDETR: A Lightweight Multi-Modal Detector CVPR 2022
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora NAACL 2022
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022
LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022
A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck COLING 2022
Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation COLING 2022
One-Teacher and Multiple-Student Knowledge Distillation on Sentiment Classification COLING 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
Semi-Supervised Domain Adaptation via Sample-to-Sample Self-Distillation WACV 2022
Incremental Cross-View Mutual Distillation for Self-Supervised Medical CT Synthesis CVPR 2022
Continual Learning through Retrieval and Imagination AAAI 2022
SAIL: Self-Augmented Graph Contrastive Learning AAAI 2022
Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression COLING 2022
Co-Segmentation Aided Two-Stream Architecture for Video Captioning WACV 2022
PERF-Net: Pose Empowered RGB-Flow Net WACV 2022
Extractive Knowledge Distillation WACV 2022
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation NAACL 2022
Plugging Self-Supervised Monocular Depth Into Unsupervised Domain Adaptation for Semantic Segmentation WACV 2022
Pixel-by-Pixel Cross-Domain Alignment for Few-Shot Semantic Segmentation WACV 2022
Data Valuation in Machine Learning: "Ingredients", Strategies, and Open Challenges IJCAI 2022
Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches CVPR 2022
Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks NAACL 2022
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching NAACL 2022
End-to-End Simultaneous Speech Translation with Pretraining and Distillation: Huawei Noah’s System for AutoSimTranS 2022 NAACL 2022
Why Knowledge Distillation Amplifies Gender Bias and How to Mitigate from the Perspective of DistilBERT NAACL 2022