conftrace_

pretraining dataset

12 papers

Explore in graph

Co-occurring keywords · papers mentioning both

language model (3) data filtering (2) multimodal learning (2) self-supervised learning (2) representation learning (2) concept frequency (1) video-language model (1) scientific discovery (1) classifier ensemble (1) model accuracy (1)

Papers

What Are They Filtering Out? An Experimental Benchmark of Filtering Strategies for Harm Reduction in Pretraining Datasets AAAI 2026 An OpenMind for 3D Medical Vision Self-supervised Learning ICCV 2025 Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset ACL 2025 SWEb: A Large Web Dataset for the Scandinavian Languages ICLR 2025 A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery EMNLP 2024 Data, Data Everywhere: A Guide for Pretraining Dataset Construction EMNLP 2024 No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance NeurIPS 2024 The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale NeurIPS 2024 UDA-Bench: Revisiting Common Assumptions in Unsupervised Domain Adaptation Using a Standardized Framework ECCV 2024 On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training NeurIPS 2023 VidChapters-7M: Video Chapters at Scale NeurIPS 2023 Contrasting Contrastive Self-Supervised Representation Learning Pipelines ICCV 2021