Foundation Models

Improving the Generalization of Segmentation Foundation Model under Distribution Shift via Weakly Supervised Adaptation CVPR 2024 Insect-Foundation: A Foundation Model and Large-scale 1M Dataset for Visual Insect Understanding CVPR 2024 Interfacing Foundation Models' Embeddings NeurIPS 2024 InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks CVPR 2024 Interpreting CLIP with Sparse Linear Concept Embeddings (SpLiCE) NeurIPS 2024 Large Pre-trained time series models for cross-domain Time series analysis tasks NeurIPS 2024 Learning Frequency-Adapted Vision Foundation Model for Domain Generalized Semantic Segmentation NeurIPS 2024 Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understanding NeurIPS 2024 Low-Resource Vision Challenges for Foundation Models CVPR 2024 Making Visual Sense of Oracle Bones for You and Me CVPR 2024 Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology CVPR 2024 Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning NeurIPS 2024 MESA: Matching Everything by Segmenting Anything CVPR 2024 MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens NeurIPS 2024 MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI CVPR 2024 Model Composition for Multimodal Large Language Models ACL 2024 Model Decides How to Tokenize: Adaptive DNA Sequence Tokenization with MxDNA NeurIPS 2024 MP-RNA: Unleashing Multi-species RNA Foundation Model via Calibrated Secondary Structure Prediction EMNLP 2024 Multi-modal Transfer Learning between Biological Foundation Models NeurIPS 2024 OceanGPT: A Large Language Model for Ocean Science Tasks ACL 2024 OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems ACL 2024 OmniGlue: Generalizable Feature Matching with Foundation Model Guidance CVPR 2024 One-Prompt to Segment All Medical Images CVPR 2024 OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning CVPR 2024 On the Evaluation of Speech Foundation Models for Spoken Language Understanding ACL 2024