Skip to content
conftrace_

pre-training tax

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

gradient-based subset training (1) subset training (1) model soup (1) data sparsity (1) ensemble diversity (1) distributed training (1) ensemble training (1) data augmentation (1)

Papers

Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit ICML 2023