← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale EMNLP 2024
Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024
An Empirical Study of Multilingual Reasoning Distillation for Question Answering EMNLP 2024
Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation INTERSPEECH 2024
Pinyin Regularization in Error Correction for Chinese Speech Recognition with Large Language Models INTERSPEECH 2024
Frequency-mix Knowledge Distillation for Fake Speech Detection INTERSPEECH 2024
BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation INTERSPEECH 2024
Speaker Change Detection with Weighted-sum Knowledge Distillation based on Self-supervised Pre-trained Models INTERSPEECH 2024
Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model INTERSPEECH 2024
ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation INTERSPEECH 2024
Enhanced Feature Learning with Normalized Knowledge Distillation for Audio Tagging INTERSPEECH 2024
Cross-transfer Knowledge between Speech and Text Encoders to Evaluate Customer Satisfaction INTERSPEECH 2024
Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations? EMNLP 2024
MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding EMNLP 2024
LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives EMNLP 2024
MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations NSDI 2024
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning ACL 2024
Learning Global Controller in Latent Space for Parameter-Efficient Fine-Tuning ACL 2024
A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques ACL 2024
Distilling Semantic Priors from SAM to Efficient Image Restoration Models CVPR 2024
SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation CVPR 2024
Three Pillars Improving Vision Foundation Model Distillation for Lidar CVPR 2024
AM-RADIO: Agglomerative Vision Foundation Model Reduce All Domains Into One CVPR 2024
Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024
A Closer Look at Claim Decomposition NAACL 2024