← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Weak-to-Strong 3D Object Detection with X-Ray Distillation CVPR 2024
Active Object Detection with Knowledge Aggregation and Distillation from Large Models CVPR 2024
SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation EMNLP 2024
ATAP: Automatic Template-Augmented Commonsense Knowledge Graph Completion via Pre-Trained Language Models EMNLP 2024
Improve Student’s Reasoning Generalizability through Cascading Decomposed CoTs Distillation EMNLP 2024
FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation EMNLP 2024
Scalable and Domain-General Abstractive Proposition Segmentation EMNLP 2024
DiConStruct: Causal Concept-based Explanations through Black-Box Distillation CLEAR 2024
Improving Continual Few-shot Relation Extraction through Relational Knowledge Distillation and Prototype Augmentation COLING 2024
Hypernetwork-Assisted Parameter-Efficient Fine-Tuning with Meta-Knowledge Distillation for Domain Knowledge Disentanglement NAACL 2024
TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration NIPS 2024
Voxel Proposal Network via Multi-Frame Knowledge Distillation for Semantic Scene Completion NIPS 2024
Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation NIPS 2024
One-shot Federated Learning via Synthetic Distiller-Distillate Communication NIPS 2024
CIFD: Controlled Information Flow to Enhance Knowledge Distillation NIPS 2024
Geometry Awakening: Cross-Geometry Learning Exhibits Superiority over Individual Structures NIPS 2024
CiteME: Can Language Models Accurately Cite Scientific Claims? NIPS 2024
Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent EMNLP 2024
S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning NIPS 2024
FedGMKD: An Efficient Prototype Federated Learning Framework through Knowledge Distillation and Discrepancy-Aware Aggregation NIPS 2024
Suitable is the Best: Task-Oriented Knowledge Fusion in Vulnerability Detection NIPS 2024
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning NIPS 2024
Fine-Tuning is Fine, if Calibrated NIPS 2024
Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis CVPR 2024
Low-Rank Knowledge Decomposition for Medical Foundation Models CVPR 2024