multimodal learning

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data ICLR 2024 Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning ICLR 2024 Neuro-Vision to Language: Enhancing Brain Recording-based Visual Reconstruction and Language Interaction NeurIPS 2024 Next Visit Diagnosis Prediction via Medical Code-Centric Multimodal Contrastive EHR Modelling with Hierarchical Regularisation EACL 2024 NLPNCHU at SemEval-2024 Task 4: A Comparison of MDHC Strategy and In-domain Pre-training for Multilingual Detection of Persuasion Techniques in Memes SemEval 2024 Noise-Aware Image Captioning with Progressively Exploring Mismatched Words AAAI 2024 Noisy Correspondence Learning with Self-Reinforcing Errors Mitigation AAAI 2024 Novel Class Discovery in Chest X-rays via Paired Images and Text AAAI 2024 nowhash at SemEval-2024 Task 4: Exploiting Fusion of Transformers for Detecting Persuasion Techniques in Multilingual Memes SemEval 2024 NuScenes-QA: A Multi-Modal Visual Question Answering Benchmark for Autonomous Driving Scenario AAAI 2024 NUS-Emo at SemEval-2024 Task 3: Instruction-Tuning LLM for Multimodal Emotion-Cause Analysis in Conversations SemEval 2024 Object Attribute Matters in Visual Question Answering AAAI 2024 Object-Aware Adaptive-Positivity Learning for Audio-Visual Question Answering AAAI 2024 OCEAN-AI: open multimodal framework for personality traits assessment and HR-processes automatization Interspeech 2024 Octopi: Object Property Reasoning with Large Tactile-Language Models RSS 2024 OLIVE: Object Level In-Context Visual Embeddings ACL 2024 OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog COLING 2024 OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding NeurIPS 2024 OMG-QA: Building Open-Domain Multi-Modal Generative Question Answering Systems EMNLP 2024 OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents NeurIPS 2024 OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM CVPR 2024 Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts CVPR 2024 OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning CVPR 2024 OmniVec: Learning Robust Representations With Cross Modal Sharing WACV 2024 OmniViD: A Generative Framework for Universal Video Understanding CVPR 2024