conftrace_

pretraining dataset

6 papers

Explore in graph

Co-occurring keywords

data filtering (99) language model (4599) concept frequency (1) video-language model (55) classifier ensemble (25) model accuracy (29) large-scale training (19) llm safety (67) temporal localization (125) dataset construction (56)

Papers

What Are They Filtering Out? An Experimental Benchmark of Filtering Strategies for Harm Reduction in Pretraining Datasets AAAI 2026
Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset ACL 2025
No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance NIPS 2024
Data, Data Everywhere: A Guide for Pretraining Dataset Construction EMNLP 2024
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale NIPS 2024
VidChapters-7M: Video Chapters at Scale NIPS 2023