Knowledge Distillation

FedID: Federated Interactive Distillation for Large-Scale Pretraining Language Models EMNLP 2023 FerKD: Surgical Label Adaptation for Efficient Distillation ICCV 2023 Few-Shot Class-Incremental Learning via Class-Aware Bilateral Distillation CVPR 2023 Few-Shot Dataset Distillation via Translative Pre-Training ICCV 2023 Few-Shot Learning of Compact Models via Task-Specific Meta Distillation WACV 2023 Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training CVPR 2023 Fine-tuning Audio Spectrogram Transformer with Task-aware Adapters for Sound Event Detection Interspeech 2023 Foreground-Background Separation through Concept Distillation from Generative Image Foundation Models ICCV 2023 Foreground Object Search by Distilling Composite Image Feature ICCV 2023 ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning NeurIPS 2023 Foundation Model is Efficient Multimodal Multitask Model Selector NeurIPS 2023 Four Approaches to Low-Resource Multilingual NMT: The Helsinki Submission to the AmericasNLP 2023 Shared Task ACL 2023 FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models EMNLP 2023 From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels ICCV 2023 FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation ICCV 2023 Function-Consistent Feature Distillation ICLR 2023 FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue ACL 2023 Generalization Matters: Loss Minima Flattening via Parameter Hybridization for Efficient Online Knowledge Distillation CVPR 2023 Generative Bias for Robust Visual Question Answering CVPR 2023 Generic-to-Specific Distillation of Masked Autoencoders CVPR 2023 Genie: Show Me the Data for Quantization CVPR 2023 GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model ACL 2023 GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023 Global Knowledge Calibration for Fast Open-Vocabulary Segmentation ICCV 2023 GLUECons: A Generic Benchmark for Learning under Constraints AAAI 2023