Knowledge Distillation

Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods ICLR 2022 Collapse by Conditioning: Training Class-conditional GANs with Limited Data ICLR 2022 Collective Relevance Labeling for Passage Retrieval NAACL 2022 Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks COLING 2022 Compressing Models With Few Samples: Mimicking Then Replacing CVPR 2022 Compression of Generative Pre-trained Language Models via Quantization ACL 2022 Conformer with dual-mode chunked attention for joint online and offline ASR Interspeech 2022 ConGen: Unsupervised Control and Generalization Distillation For Sentence Representation EMNLP 2022 Contact-Distil: Boosting Low Homologous Protein Contact Map Prediction by Self-Supervised Distillation AAAI 2022 Content-Variant Reference Image Quality Assessment via Knowledge Distillation AAAI 2022 Contextual Similarity Distillation for Asymmetric Image Retrieval CVPR 2022 Continual Federated Learning Based on Knowledge Distillation IJCAI 2022 Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization EMNLP 2022 Cosine Model Watermarking against Ensemble Distillation AAAI 2022 Cross Domain Object Detection by Target-Perceived Dual Branch Distillation CVPR 2022 Cross-Image Relational Knowledge Distillation for Semantic Segmentation CVPR 2022 Cross-Layer Similarity Knowledge Distillation for Speech Enhancement Interspeech 2022 Cross-Task Knowledge Distillation in Multi-Task Recommendation AAAI 2022 CUNI Non-Autoregressive System for the WMT 22 Efficient Translation Shared Task EMNLP 2022 Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment Analysis EMNLP 2022 Data-Free Adversarial Knowledge Distillation for Graph Neural Networks IJCAI 2022 DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers CVPR 2022 Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation NeurIPS 2022 Decomposing NeRF for Editing via Feature Field Distillation NeurIPS 2022 Decoupled Knowledge Distillation CVPR 2022