← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Are Large-scale Soft Labels Necessary for Large-scale Dataset Distillation? NIPS 2024
IDC: Boost Text-to-image Retrieval via Indirect and Direct Connections COLING 2024
HYPERTTS: Parameter Efficient Adaptation in Text to Speech Using Hypernetworks COLING 2024
Prophecy Distillation for Boosting Abstractive Summarization COLING 2024
Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure NAACL 2024
Self-Regulated Data-Free Knowledge Amalgamation for Text Classification NAACL 2024
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024
Towards Multi-modal Sarcasm Detection via Disentangled Multi-grained Multi-modal Distilling COLING 2024
Self-Knowledge Distillation for Knowledge Graph Embedding COLING 2024
DimA: A Parameter-efficient Fine-tuning Method with Knowledge Transfer Based on Transformer COLING 2024
Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation COLING 2024
Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness NIPS 2024
Logit Standardization in Knowledge Distillation CVPR 2024
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling CVPR 2024
Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach CVPR 2024
VkD: Improving Knowledge Distillation using Orthogonal Projections CVPR 2024
CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation CVPR 2024
SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking CVPR 2024
Efficient Stitchable Task Adaptation CVPR 2024
Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification CVPR 2024
CaKDP: Category-aware Knowledge Distillation and Pruning Framework for Lightweight 3D Object Detection CVPR 2024
Language-aware Visual Semantic Distillation for Video Question Answering CVPR 2024
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation CVPR 2024
De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts CVPR 2024
FedPFT: Federated Proxy Fine-Tuning of Foundation Models IJCAI 2024