knowledge distillation

FastAST: Accelerating Audio Spectrogram Transformer via Token Merging and Cross-Model Knowledge Distillation Interspeech 2024 Fast-ELECTRA for Efficient Pre-training ICLR 2024 Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward IJCAI 2024 FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline WACV 2024 Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024 FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillation Interspeech 2024 Favoring One Among Equals - Not a Good Idea: Many-to-One Matching for Robust Transformer Based Pedestrian Detection WACV 2024 FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental Learning CVPR 2024 FedCD: Federated Semi-Supervised Learning with Class Awareness Balance via Dual Teachers AAAI 2024 FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning AAAI 2024 FedDGL: Federated Dynamic Graph Learning for Temporal Evolution and Data Heterogeneity ACML 2024 Federated Learning via Input-Output Collaborative Distillation AAAI 2024 Federated Learning with Extremely Noisy Clients via Negative Distillation AAAI 2024 Federated Model Heterogeneous Matryoshka Representation Learning NeurIPS 2024 FedGMKD: An Efficient Prototype Federated Learning Framework through Knowledge Distillation and Discrepancy-Aware Aggregation NeurIPS 2024 FedGTST: Boosting Global Transferability of Federated Models via Statistics Tuning NeurIPS 2024 FedLTF: Linear Probing Teaches Fine-tuning to Mitigate Noisy Labels in Federated Learning ACML 2024 FedPFT: Federated Proxy Fine-Tuning of Foundation Models IJCAI 2024 FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning IJCAI 2024 Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language AAAI 2024 Fine-Grained Distillation for Long Document Retrieval AAAI 2024 Fine-grained Image-to-LiDAR Contrastive Distillation with Visual Foundation Models NeurIPS 2024 Fine-Grained Knowledge Selection and Restoration for Non-exemplar Class Incremental Learning AAAI 2024 Fine-Grained Prototypes Distillation for Few-Shot Object Detection AAAI 2024 Fine-Tuning is Fine, if Calibrated NeurIPS 2024