conftrace_

domain reweighting

4 papers

Explore in graph

Co-occurring keywords · papers mentioning both

continual pre-training (2) learning velocity (1) few-shot reasoning (1) large language model (1) math reasoning (1) dynamic sampling (1) few-shot downstream accuracy (1) data mixing agent (1) perplexity (1) generalization estimation (1)

Papers

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training ACL 2026 Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training ACL 2025 DOGE: Domain Reweighting with Generalization Estimation ICML 2024 DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining NeurIPS 2023