Skip to content
conftrace_

dense fine-tuning

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

sparse pre-training (1) flip rate (1) masked decay term (1) weight sparsity (1) large language model (1) 2:4 sparsity (1) feed-forward network (1) sparsity (1) knowledge transfer (1) model compression (1)

Papers

Accelerating Transformer Pre-training with 2:4 Sparsity ICML 2024 SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models UAI 2023