Knowledge Distillation

FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions WACV 2024 Fusing Models with Complementary Expertise ICLR 2024 GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model Interspeech 2024 Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024 Generating Images with 3D Annotations Using Diffusion Models ICLR 2024 Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model EACL 2024 Generative Model-Based Feature Knowledge Distillation for Action Recognition AAAI 2024 Geometry Awakening: Cross-Geometry Learning Exhibits Superiority over Individual Structures NeurIPS 2024 GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024 GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation NAACL 2024 GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024 GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation EMNLP 2024 Gradient-Guided Knowledge Distillation for Object Detectors WACV 2024 Graph Attention Network with High-Order Neighbor Information Propagation for Social Recommendation IJCAI 2024 Guided Distillation for Semi-Supervised Instance Segmentation WACV 2024 Guiding Clinical Reasoning with Large Language Models via Knowledge Seeds IJCAI 2024 Guiding Frame-Level CTC Alignments Using Self-knowledge Distillation Interspeech 2024 Hear You Say You: An Efficient Framework for Marine Mammal Sounds’ Classification AAAI 2024 HGP-NLP at BioLaySumm: Leveraging LoRA for Lay Summarization of Biomedical Research Articles using Seq2Seq Transformers ACL 2024 HiFi-Gas: Hierarchical Federated Learning Incentive Mechanism Enhanced Gas Usage Estimation AAAI 2024 Holistic Features are almost Sufficient for Text-to-Video Retrieval CVPR 2024 How Good is a Single Basin? AISTATS 2024 How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval? CVPR 2024 How to Trade Off the Quantity and Capacity of Teacher Ensemble: Learning Categorical Distribution to Stochastically Employ a Teacher for Distillation AAAI 2024 Hybrid Distillation: Connecting Masked Autoencoders with Contrastive Learners ICLR 2024