conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation COLING 2022
One-Teacher and Multiple-Student Knowledge Distillation on Sentiment Classification COLING 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
Semi-Supervised Domain Adaptation via Sample-to-Sample Self-Distillation WACV 2022
Incremental Cross-View Mutual Distillation for Self-Supervised Medical CT Synthesis CVPR 2022
Continual Learning through Retrieval and Imagination AAAI 2022
SAIL: Self-Augmented Graph Contrastive Learning AAAI 2022
Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression COLING 2022
Co-Segmentation Aided Two-Stream Architecture for Video Captioning WACV 2022
PERF-Net: Pose Empowered RGB-Flow Net WACV 2022
Extractive Knowledge Distillation WACV 2022
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation NAACL 2022
Plugging Self-Supervised Monocular Depth Into Unsupervised Domain Adaptation for Semantic Segmentation WACV 2022
Pixel-by-Pixel Cross-Domain Alignment for Few-Shot Semantic Segmentation WACV 2022
Data Valuation in Machine Learning: "Ingredients", Strategies, and Open Challenges IJCAI 2022
Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches CVPR 2022
Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks NAACL 2022
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching NAACL 2022
End-to-End Simultaneous Speech Translation with Pretraining and Distillation: Huawei Noah’s System for AutoSimTranS 2022 NAACL 2022
Why Knowledge Distillation Amplifies Gender Bias and How to Mitigate from the Perspective of DistilBERT NAACL 2022
MTGLS: Multi-Task Gaze Estimation With Limited Supervision WACV 2022
Improving Object Detection by Label Assignment Distillation WACV 2022
Distilling a Pretrained Language Model to a Multilingual ASR Model INTERSPEECH 2022
Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition INTERSPEECH 2022
C3PO: A Lightweight Copying Mechanism for Translating Pseudocode to Code IJCNLP 2022