← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale NIPS 2024
COMBHelper: A Neural Approach to Reduce Search Space for Graph Combinatorial Problems AAAI 2024
Efficient Dataset Distillation via Minimax Diffusion CVPR 2024
Multi-Expert Distillation for Few-Shot Coordination (Student Abstract) AAAI 2024
Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation NAACL 2024
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment ACL 2024
Distillation Enhanced Generative Retrieval ACL 2024
Balancing Speciality and Versatility: a Coarse to Fine Framework for Supervised Fine-tuning Large Language Model ACL 2024
PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees CVPR 2024
Class Incremental Learning with Multi-Teacher Distillation CVPR 2024
API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs ACL 2024
HYPERTTS: Parameter Efficient Adaptation in Text to Speech Using Hypernetworks COLING 2024
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation ACL 2024
Confidence Matters: Enhancing Medical Image Classification Through Uncertainty-Driven Contrastive Self-Distillation MICCAI 2024
Prophecy Distillation for Boosting Abstractive Summarization COLING 2024
Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning ACL 2024
Towards Continual Knowledge Graph Embedding via Incremental Distillation AAAI 2024
Machine Learning-Powered Combinatorial Clock Auction AAAI 2024
CONSCENDI: A Contrastive and Scenario-Guided Distillation Approach to Guardrail Models for Virtual Assistants NAACL 2024
Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024
Benchmarking Diffusion Models for Machine Translation EACL 2024
CTC-based Non-autoregressive Textless Speech-to-Speech Translation ACL 2024
Cache & Distil: Optimising API Calls to Large Language Models ACL 2024
LaKD: Length-agnostic Knowledge Distillation for Trajectory Prediction with Any Length Observations NIPS 2024
LungAdapter: Efficient Adapting Audio Spectrogram Transformer for Lung Sound Classification INTERSPEECH 2024