conftrace_

sampling weight

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

language model (2) pretraining efficiency (1) dynamic data mixture (1) token routing (1) data deduplication (1) data mixing (1) soft deduplication (1) few-shot accuracy (1) language model pretraining (1) data reweighting (1)

Papers

Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts NAACL 2025 SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training ACL 2024