Knowledge Distillation

Label Attentive Distillation for GNN-Based Graph Classification AAAI 2024 LaKD: Length-agnostic Knowledge Distillation for Trajectory Prediction with Any Length Observations NeurIPS 2024 LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions EACL 2024 Language-aware Visual Semantic Distillation for Video Question Answering CVPR 2024 Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection IJCAI 2024 Large Language Models are Efficient Learners of Noise-Robust Speech Recognition ICLR 2024 Large Language Models for Human-AI Co-Creation of Robotic Dance Performances IJCAI 2024 Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation AAAI 2024 Learning Background Prompts to Discover Implicit Knowledge for Open Vocabulary Object Detection CVPR 2024 Learning Better Representations From Less Data For Propositional Satisfiability NeurIPS 2024 Learning Continual Compatible Representation for Re-indexing Free Lifelong Person Re-identification CVPR 2024 Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning Interspeech 2024 Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024 Learning from Natural Language Explanations for Generalizable Entity Matching EMNLP 2024 Learning Global Controller in Latent Space for Parameter-Efficient Fine-Tuning ACL 2024 LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024 Leros: Learning Explicit Reasoning on Synthesized Data for Commonsense Question Answering COLING 2024 Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation ICLR 2024 Let All Be Whitened: Multi-Teacher Distillation for Efficient Visual Retrieval AAAI 2024 Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detection AAAI 2024 Leveraging Normalization Layer in Adapters with Progressive Learning and Adaptive Distillation for Cross-Domain Few-Shot Learning AAAI 2024 Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification CVPR 2024 LexDrafter: Terminology Drafting for Legislative Documents Using Retrieval Augmented Generation COLING 2024 LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis WACV 2024 LightHGNN: Distilling Hypergraph Neural Networks into MLPs for 100x Faster Inference ICLR 2024