← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent EMNLP 2024
An LLM-Enhanced Adversarial Editing System for Lexical Simplification COLING 2024
Distillation with Explanations from Large Language Models COLING 2024
Small Scale Data-Free Knowledge Distillation CVPR 2024
DimA: A Parameter-efficient Fine-tuning Method with Knowledge Transfer Based on Transformer COLING 2024
CTC-based Non-autoregressive Textless Speech-to-Speech Translation ACL 2024
Uncertainty-Guided Never-Ending Learning to Drive CVPR 2024
Improved Distribution Matching Distillation for Fast Image Synthesis NIPS 2024
FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions WACV 2024
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024
FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation EMNLP 2024
SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation EMNLP 2024
ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024
Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024
Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever ACL 2024
3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding ACL 2024
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment ACL 2024
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment ACL 2024
Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale NIPS 2024
Distillation Enhanced Generative Retrieval ACL 2024
AraCLIP: Cross-Lingual Learning for Effective Arabic Image Retrieval ACL 2024
Multi-Expert Distillation for Few-Shot Coordination (Student Abstract) AAAI 2024
Self-Knowledge Distillation for Knowledge Graph Embedding COLING 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models ACL 2024
VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models EMNLP 2024