← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior CVPR 2024
Small Scale Data-Free Knowledge Distillation CVPR 2024
TASeg: Temporal Aggregation Network for LiDAR Semantic Segmentation CVPR 2024
De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts CVPR 2024
CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs CVPR 2024
Understanding the Gains from Repeated Self-Distillation NIPS 2024
What Matters in Graph Class Incremental Learning? An Information Preservation Perspective NIPS 2024
Happy: A Debiased Learning Framework for Continual Generalized Category Discovery NIPS 2024
Learning Better Representations From Less Data For Propositional Satisfiability NIPS 2024
HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoid NIPS 2024
FedGTST: Boosting Global Transferability of Federated Models via Statistics Tuning NIPS 2024
SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Models NIPS 2024
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models NIPS 2024
DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception NIPS 2024
Compact Language Models via Pruning and Knowledge Distillation NIPS 2024
SlimSAM: 0.1% Data Makes Segment Anything Slim NIPS 2024
Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate NIPS 2024
Variational Distillation of Diffusion Policies into Mixture of Experts NIPS 2024
Multistep Distillation of Diffusion Models via Moment Matching NIPS 2024
Hollowed Net for On-Device Personalization of Text-to-Image Diffusion Models NIPS 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery NIPS 2024
Boosting Vision-Language Models with Transduction NIPS 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
Cross-modal Representation Flattening for Multi-modal Domain Generalization NIPS 2024