← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training CVPR 2024
Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation CVPR 2024
Sunshine to Rainstorm: Cross-Weather Knowledge Distillation for Robust 3D Object Detection AAAI 2024
Semi-Supervised Blind Image Quality Assessment through Knowledge Distillation and Incremental Learning AAAI 2024
LoQT: Low-Rank Adapters for Quantized Pretraining NIPS 2024
A teacher-teacher framework for clinical language representation learning NIPS 2024
RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation EMNLP 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models NIPS 2024
Offline Behavior Distillation NIPS 2024
PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation CVPR 2024
On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving CVPR 2024
One-step Diffusion with Distribution Matching Distillation CVPR 2024
MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training CVPR 2024
Towards Backward-Compatible Continual Learning of Image Compression CVPR 2024
Distilling ODE Solvers of Diffusion Models into Smaller Steps CVPR 2024
Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation CVPR 2024
MTLoRA: Low-Rank Adaptation Approach for Efficient Multi-Task Learning CVPR 2024
Cross-Dimension Affinity Distillation for 3D EM Neuron Segmentation CVPR 2024
Teaching Tiny Minds: Exploring Methods to Enhance Knowledge Distillation for Small Language Models CONLL 2024
TransferCVLM: Transferring Cross-Modal Knowledge for Vision-Language Modeling EMNLP 2024
Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation EMNLP 2024
CapEEN: Image Captioning with Early Exits and Knowledge Distillation EMNLP 2024
Translate Meanings, Not Just Words: IdiomKB’s Role in Optimizing Idiomatic Translation with Language Models AAAI 2024
Evolutionary Contrastive Distillation for Language Model Alignment EMNLP 2024
Dual-teacher Knowledge Distillation for Low-frequency Word Translation EMNLP 2024