Skip to content
conftrace_

large-scale pretraining

10 papers

Explore in graph

Co-occurring keywords · papers mentioning both

transfer learning (3) vision-language model (2) image-text pair (2) multimodal learning (2) vision transformer (2) contrastive learning (2) representation learning (2) expression discovery (1) interleaved data (1) open-source dataset (1)

Papers

TraceGen: World Modeling in 3D Trace Space Enables Learning from Cross-Embodiment Videos CVPR 2026 Contrastive Localized Language-Image Pre-Training ICML 2025 Data Engineering for Scaling Language Models to 128K Context ICML 2024 MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens NeurIPS 2024 GAFNet: A Global Fourier Self Attention Based Novel Network for Multi-Modal Downstream Tasks WACV 2023 Masked Autoencoding Does Not Help Natural Language Supervision at Scale CVPR 2023 A Unified Framework for Deep Symbolic Regression NeurIPS 2022 Billion-Scale Pretraining With Vision Transformers for Multi-Task Visual Representations WACV 2022 Exploring the Limits of Large Scale Pre-training ICLR 2022 MetaMorph: Learning Universal Controllers with Transformers ICLR 2022