Multimodal Learning

OneLLM: One Framework to Align All Modalities with Language CVPR 2024 On Scaling Up a Multilingual Vision and Language Model CVPR 2024 On Stronger Computational Separations Between Multimodal and Unimodal Machine Learning ICML 2024 On the Language Encoder of Contrastive Cross-modal Models ACL 2024 On the Robustness of Large Multimodal Models Against Image Adversarial Attacks CVPR 2024 Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance CVPR 2024 OpenESS: Event-based Semantic Scene Understanding with Open Vocabularies CVPR 2024 OpenOmni: A Collaborative Open Source Tool for Building Future-Ready Multimodal Conversational Agents EMNLP 2024 Open-Vocabulary 3D Semantic Segmentation with Foundation Models CVPR 2024 Open Vocabulary Semantic Scene Sketch Understanding CVPR 2024 Open-Vocabulary Video Relation Extraction AAAI 2024 Open-World Human-Object Interaction Detection via Multi-modal Prompts CVPR 2024 Open-world Multi-label Text Classification with Extremely Weak Supervision EMNLP 2024 OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation CVPR 2024 Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks NeurIPS 2024 Overcome Modal Bias in Multi-modal Federated Learning via Balanced Modality Selection ECCV 2024 Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Models NAACL 2024 OVER-NAV: Elevating Iterative Vision-and-Language Navigation with Open-Vocabulary Detection and StructurEd Representation CVPR 2024 Overview of Shared Task on Multitask Meme Classification - Unraveling Misogynistic and Trolls in Online Memes EACL 2024 OVFoodSeg: Elevating Open-Vocabulary Food Image Segmentation via Image-Informed Textual Representation CVPR 2024 PairAug: What Can Augmented Image-Text Pairs Do for Radiology? CVPR 2024 PAIR Diffusion: A Comprehensive Multimodal Object-Level Image Editor CVPR 2024 PALM: Few-Shot Prompt Learning for Audio Language Models EMNLP 2024 PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation CVPR 2024 Partial Multi-View Multi-Label Classification via Semantic Invariance Learning and Prototype Modeling ICML 2024