← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Progressive Distillation Based on Masked Generation Feature Method for Knowledge Graph Completion AAAI 2024
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024
ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024
Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever ACL 2024
3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding ACL 2024
DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling ACL 2024
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering ACL 2024
Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024
AraCLIP: Cross-Lingual Learning for Effective Arabic Image Retrieval ACL 2024
Fine-Grained Distillation for Long Document Retrieval AAAI 2024
GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
Complementary Knowledge Distillation for Robust and Privacy-Preserving Model Serving in Vertical Federated Learning AAAI 2024
Hear You Say You: An Efficient Framework for Marine Mammal Sounds’ Classification AAAI 2024
Unveiling the Magic: Investigating Attention Distillation in Retrieval-Augmented Generation NAACL 2024
Distilling Text Style Transfer With Self-Explanation From LLMs NAACL 2024
Reducing hallucination in structured outputs via Retrieval-Augmented Generation NAACL 2024
Self-Regulated Data-Free Knowledge Amalgamation for Text Classification NAACL 2024
Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure NAACL 2024
LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024
Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024
FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions WACV 2024
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering ACL 2024
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models ACL 2024