knowledge distillation

Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022 PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models CVPR 2022 PERF-Net: Pose Empowered RGB-Flow Net WACV 2022 Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022 Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks AACL 2022 PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation EMNLP 2022 Pixel-by-Pixel Cross-Domain Alignment for Few-Shot Semantic Segmentation WACV 2022 PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NeurIPS 2022 Plug and Play Knowledge Distillation for kNN-LM with External Logits AACL 2022 Plugging Self-Supervised Monocular Depth Into Unsupervised Domain Adaptation for Semantic Segmentation WACV 2022 Point-Level Region Contrast for Object Detection Pre-Training CVPR 2022 Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation CVPR 2022 Pose-Invariant Face Recognition via Adaptive Angular Distillation AAAI 2022 Post-Training with Interrogative Sentences for Enhancing BART-based Korean Question Generator AACL 2022 PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression WACV 2022 Predicting Prerequisite Relations for Unseen Concepts EMNLP 2022 Preservation of the Global Knowledge by Not-True Distillation in Federated Learning NeurIPS 2022 Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation AAAI 2022 Pretrained Speech Encoders and Efficient Fine-tuning Methods for Speech Translation: UPC at IWSLT 2022 ACL 2022 Pre-Train, Self-Train, Distill: A Simple Recipe for Supersizing 3D Reconstruction CVPR 2022 Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data WACV 2022 Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency ACL 2022 Production federated keyword spotting via distillation, filtering, and joint federated-centralized training Interspeech 2022 Progressive Distillation for Fast Sampling of Diffusion Models ICLR 2022 Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022