← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities CVPR 2024
Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios CVPR 2024
Adversarial Distillation Based on Slack Matching and Attribution Region Alignment CVPR 2024
Robust Distillation via Untargeted and Targeted Intermediate Adversarial Samples CVPR 2024
PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees CVPR 2024
Class Incremental Learning with Multi-Teacher Distillation CVPR 2024
PromptKD: Unsupervised Prompt Distillation for Vision-Language Models CVPR 2024
Continual Segmentation with Disentangled Objectness Learning and Class Recognition CVPR 2024
Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentation NIPS 2024
Learning from Natural Language Explanations for Generalizable Entity Matching EMNLP 2024
Bridging Language Gaps in Audio-Text Retrieval INTERSPEECH 2024
Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection INTERSPEECH 2024
Improving Audio Classification with Low-Sampled Microphone Input: An Empirical Study Using Model Self-Distillation INTERSPEECH 2024
Navigating Continual Test-time Adaptation with Symbiosis Knowledge IJCAI 2024
Distilling Knowledge from Text-to-Image Generative Models Improves Visio-Linguistic Reasoning in CLIP EMNLP 2024
Llama SLayer 8B: Shallow Layers Hold the Key to Knowledge Injection EMNLP 2024
Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning EMNLP 2024
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models EMNLP 2024
Change Is the Only Constant: Dynamic LLM Slicing based on Layer Redundancy EMNLP 2024
PracticalDG: Perturbation Distillation on Vision-Language Models for Hybrid Domain Generalization CVPR 2024
Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation CVPR 2024
Distilling Vision-Language Models on Millions of Videos CVPR 2024
Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models CVPR 2024