conftrace_

pretraining data curation

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) english language identification (1) web text processing (1) web text (1) pretraining data (1) topic taxonomy (1) quality filter (1) domain mixing (1) web corpora (1) data filtering (1)

Papers

Organize the Web: Constructing Domains Enhances Pre-Training Data Curation ICML 2025 AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters ACL 2024