pretraining

Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfer ICML 2025 Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Trees ICML 2025 Trajectory World Models for Heterogeneous Environments ICML 2025 UniSim: A Unified Simulator for Time-Coarsened Dynamics of Biomolecules ICML 2025 ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopy ICML 2025 When Bad Data Leads to Good Models ICML 2025 Whitened CLIP as a Likelihood Surrogate of Images and Captions ICML 2025 Zebra: In-Context Generative Pretraining for Solving Parametric PDEs ICML 2025 A Comprehensive Benchmark of Supervised and Self-supervised Pre-training on Multi-view Chest X-ray Classification MIDL 2024 A decoder-only foundation model for time-series forecasting ICML 2024 AdsorbDiff: Adsorbate Placement via Conditional Denoising Diffusion ICML 2024 A Graph is Worth K Words: Euclideanizing Graph using Pure Transformer ICML 2024 CARTE: Pretraining and Transfer for Tabular Learning ICML 2024 Collage: Light-Weight Low-Precision Strategy for LLM Training ICML 2024 Contrastive ground-level image and remote sensing pre-training improves representation learning for natural world imagery ECCV 2024 DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training ICML 2024 ESM All-Atom: Multi-Scale Protein Language Model for Unified Molecular Modeling ICML 2024 Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks ICML 2024 Event-Based Contrastive Learning for Medical Time Series MLHC 2024 Exploring the Benefit of Activation Sparsity in Pre-training ICML 2024 Exploring the LLM Journey from Cognition to Expression with Linear Representations ICML 2024 Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models ICML 2024 How Deep Do We Need: Accelerating Training and Inference of Neural ODEs via Control Perspective ICML 2024 JointMotion: Joint Self-Supervision for Joint Motion Prediction CoRL 2024 LangCell: Language-Cell Pre-training for Cell Identity Understanding ICML 2024