conftrace_

soft deduplication

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

few-shot accuracy (1) data deduplication (1) sampling weight (1) pretraining efficiency (1) language model pretraining (1) data reweighting (1) n-gram model (1) language model (1) training efficiency (1)

Papers

SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training ACL 2024