← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Small Scale Data-Free Knowledge Distillation CVPR 2024
Choosy Babies Need One Coach: Inducing Mode-Seeking Behavior in BabyLlama with Reverse KL Divergence CONLL 2024
BabyLlama-2: Ensemble-Distilled Models Consistently Outperform Teachers With Limited Data CONLL 2024
When Babies Teach Babies: Can student knowledge sharing outperform Teacher-Guided Distillation on small datasets? CONLL 2024
Further Compressing Distilled Language Models via Frequency-aware Partial Sparse Coding of Embeddings CONLL 2024
PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs CVPR 2024
Cloud-Device Collaborative Learning for Multimodal Large Language Models CVPR 2024
Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners CVPR 2024
Building Vision-Language Models on Solid Foundations with Masked Distillation CVPR 2024
BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CONLL 2024
Task-Aware Encoder Control for Deep Video Compression CVPR 2024
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024
Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models NIPS 2024
How Good is a Single Basin? AISTATS 2024
FouRA: Fourier Low-Rank Adaptation NIPS 2024
Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation CVPR 2024
What Sketch Explainability Really Means for Downstream Tasks? CVPR 2024
Instance-level Expert Knowledge and Aggregate Discriminative Attention for Radiology Report Generation CVPR 2024
FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models NIPS 2024
Efficient Multi-task LLM Quantization and Serving for Multiple LoRA Adapters NIPS 2024
Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering ACL 2024
StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements EMNLP 2024
Multistep Distillation of Diffusion Models via Moment Matching NIPS 2024
Accurate Knowledge Distillation via n-best Reranking NAACL 2024