Multimodal Learning

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems ACL 2024 OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer EMNLP 2024 OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding NeurIPS 2024 OmniDialog: A Multimodal Benchmark for Generalization Across Text, Visual, and Audio Modalities EMNLP 2024 OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents NeurIPS 2024 OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM CVPR 2024 OmniParser: A Unified Framework for Text Spotting Key Information Extraction and Table Recognition CVPR 2024 Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts CVPR 2024 OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning CVPR 2024 OmniVec: Learning Robust Representations With Cross Modal Sharing WACV 2024 OmniViD: A Generative Framework for Universal Video Understanding CVPR 2024 On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning EMNLP 2024 One for All: A Universal Generator for Concept Unlearnability via Multi-Modal Alignment ICML 2024 OneLLM: One Framework to Align All Modalities with Language CVPR 2024 One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models CVPR 2024 One-Shot Open Affordance Learning with Foundation Models CVPR 2024 On Fake News Detection with LLM Enhanced Semantics Mining EMNLP 2024 Online Continuous Generalized Category Discovery ECCV 2024 OnlineTAS: An Online Baseline for Temporal Action Segmentation NeurIPS 2024 On Scaling Up a Multilingual Vision and Language Model CVPR 2024 On Stronger Computational Separations Between Multimodal and Unimodal Machine Learning ICML 2024 On the Comparison between Multi-modal and Single-modal Contrastive Learning NeurIPS 2024 On the Computational Benefit of Multimodal Learning ALT 2024 On the Effectiveness of Acoustic BPE in Decoder-Only TTS Interspeech 2024 On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models Interspeech 2024