Skip to content
conftrace_

dense checkpoint

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

adaptive layer (1) model upcycling (1) checkpoint reuse (1) sparsely activated model (1) sparse training (1) model fine-tuning (1) mixture of expert (1) convergence speed (1) computer vision (1) transfer learning (1)

Papers

MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks NeurIPS 2024 Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints ICLR 2023