Multimodal Learning

MVBench: A Comprehensive Multi-modal Video Understanding Benchmark CVPR 2024 MVP-Bench: Can Large Vision-Language Models Conduct Multi-level Visual Perception Like Humans? EMNLP 2024 Navigating the Nuances: A Fine-grained Evaluation of Vision-Language Navigation EMNLP 2024 ND-MRM: Neuronal Diversity Inspired Multisensory Recognition Model AAAI 2024 Negative Pre-aware for Noisy Cross-Modal Matching AAAI 2024 Neighbor Similarity and Multimodal Alignment based Product Recommendation Study UAI 2024 NeuroBOLT: Resting-state EEG-to-fMRI Synthesis with Multi-dimensional Feature Mapping NeurIPS 2024 No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languages EMNLP 2024 Noise-Aware Image Captioning with Progressively Exploring Mismatched Words AAAI 2024 Noisy Correspondence Learning with Self-Reinforcing Errors Mitigation AAAI 2024 Novel Class Discovery in Chest X-rays via Paired Images and Text AAAI 2024 No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance NeurIPS 2024 O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representation ECCV 2024 Object Attribute Matters in Visual Question Answering AAAI 2024 Object-Aware Adaptive-Positivity Learning for Audio-Visual Question Answering AAAI 2024 Object-Aware Query Perturbation for Cross-Modal Image-Text Retrieval ECCV 2024 Octopus: A Multi-modal LLM with Parallel Recognition and Sequential Understanding NeurIPS 2024 OdiaGenAI’s Participation in WMT2024 English-to-Low Resource Multimodal Translation Task EMNLP 2024 OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer EMNLP 2024 OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding NeurIPS 2024 OMG-QA: Building Open-Domain Multi-Modal Generative Question Answering Systems EMNLP 2024 OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents NeurIPS 2024 Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts CVPR 2024 On Disentanglement of Asymmetrical Knowledge Transfer for Modality-Task Agnostic Federated Learning AAAI 2024 One for All: A Universal Generator for Concept Unlearnability via Multi-Modal Alignment ICML 2024