Knowledge Distillation

Enhancing the General Agent Capabilities of Low-Paramter LLMs through Tuning and Multi-Branch Reasoning NAACL 2024 EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NeurIPS 2024 eTag: Class-Incremental Learning via Embedding Distillation and Task-Oriented Generation AAAI 2024 Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline CVPR 2024 Evolutionary Contrastive Distillation for Language Model Alignment EMNLP 2024 Evolving Knowledge Distillation with Large Language Models and Active Learning COLING 2024 Expanding Expressiveness of Diffusion Models With Limited Data via Self-Distillation Based Fine-Tuning WACV 2024 Expediting Contrastive Language-Image Pretraining via Self-Distilled Encoders AAAI 2024 Expert-level protocol translation for self-driving labs NeurIPS 2024 Exploiting CLIP for Zero-Shot HOI Detection Requires Knowledge Distillation at Multiple Levels WACV 2024 Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation CVPR 2024 Exploring compressibility of transformer based text-to-music (TTM) models Interspeech 2024 Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios CVPR 2024 Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models IJCAI 2024 Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection AAAI 2024 Exploring Target Representations for Masked Autoencoders ICLR 2024 Extending Power of Nature from Binary to Real-Valued Graph Learning in Real World ICLR 2024 FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation WACV 2024 Fake It Till Make It: Federated Learning with Consensus-Oriented Generation ICLR 2024 Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model ICLR 2024 FastAST: Accelerating Audio Spectrogram Transformer via Token Merging and Cross-Model Knowledge Distillation Interspeech 2024 Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024 FD3D: Exploiting Foreground Depth Map for Feature-Supervised Monocular 3D Object Detection AAAI 2024 Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields CVPR 2024 FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning AAAI 2024