Organize the Web: Constructing Domains Enhances Pre-Training Data Curation

Alexander Wettig; Kyle Lo; Sewon Min; Hannaneh Hajishirzi; Danqi Chen; Luca Soldaini

2025 ICML ICML 2025

Organize the Web: Constructing Domains Enhances Pre-Training Data Curation

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Alexander Wettig, Kyle Lo, Sewon Min, Hannaneh Hajishirzi, Danqi Chen, Luca Soldaini

Topics

Machine Learning > Core Methods > Classification Natural Language Processing > Resources & Methods > Large Language Models Artificial Intelligence > Core AI > Large Language Models

Keywords

classifier pretraining data curation large language model topic taxonomy domain mixing web corpora

Download PDF