Foundation Models

Open-Vocabulary 3D Semantic Segmentation with Foundation Models CVPR 2024 OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification ACL 2024 OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer Interspeech 2024 Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization ICLR 2024 Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models NeurIPS 2024 Poseidon: Efficient Foundation Models for PDEs NeurIPS 2024 Predicting the Performance of Foundation Models via Agreement-on-the-Line NeurIPS 2024 PRISM: A New Lens for Improved Color Understanding EMNLP 2024 Probing the 3D Awareness of Visual Foundation Models CVPR 2024 Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation NeurIPS 2024 Relational Programming with Foundational Models AAAI 2024 Representing Part-Whole Hierarchies in Foundation Models by Learning Localizability Composability and Decomposability from Anatomy via Self Supervision CVPR 2024 RobustSAM: Segment Anything Robustly on Degraded Images CVPR 2024 Segmental and Suprasegmental Speech Foundation Models for Classifying Cognitive Risk Factors: Evaluating Out-of-the-Box Performance Interspeech 2024 Segment Any Change NeurIPS 2024 Segment Anything, From Space? WACV 2024 SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery CVPR 2024 SRTube: Video-Language Pre-Training with Action-Centric Video Tube Features and Semantic Role Labeling CVPR 2024 Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models NeurIPS 2024 The Multimodal Universe: Enabling Large-Scale Machine Learning with 100 TB of Astronomical Scientific Data NeurIPS 2024 Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting NeurIPS 2024 TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learning NeurIPS 2024 Towards a "Universal Translator" for Neural Dynamics at Single-Cell, Single-Spike Resolution NeurIPS 2024 Towards Global Optimal Visual In-Context Learning Prompt Selection NeurIPS 2024 Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking NeurIPS 2024