Multimodal Learning

Multimodal Relation Extraction with Cross-Modal Retrieval and Synthesis ACL 2023 Multimodal Variational Auto-encoder based Audio-Visual Segmentation ICCV 2023 MultiMoDN—Multimodal, Multi-Task, Interpretable Modular Networks NeurIPS 2023 MultiQG-TI: Towards Question Generation from Multi-modal Sources ACL 2023 Multi-Resolution Sensing for Real-Time Control with Vision-Language Models CoRL 2023 MultiSCOPE: Disambiguating In-Hand Object Poses with Proprioception and Tactile Feedback RSS 2023 Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generation ACL 2023 Multitask Multimodal Prompted Training for Interactive Embodied Task Completion EMNLP 2023 Multivariate, Multi-Frequency and Multimodal: Rethinking Graph Neural Networks for Emotion Recognition in Conversation CVPR 2023 MultiVENT: Multilingual Videos of Events and Aligned Natural Text NeurIPS 2023 Multi-View Masked World Models for Visual Robotic Manipulation ICML 2023 MultiViz: Towards Visualizing and Understanding Multimodal Models ICLR 2023 MultiZoo and MultiBench: A Standardized Toolkit for Multimodal Deep Learning JMLR 2023 MuMIC – Multimodal Embedding for Multi-Label Image Classification with Tempered Sigmoid AAAI 2023 MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data NeurIPS 2023 MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models EMNLP 2023 Music-Driven Group Choreography CVPR 2023 MUST&P-SRL: Multi-lingual and Unified Syllabification in Text and Phonetic Domains for Speech Representation Learning EMNLP 2023 MUTEX: Learning Unified Policies from Multimodal Task Specifications CoRL 2023 Mutual-Enhanced Incongruity Learning Network for Multi-Modal Sarcasm Detection AAAI 2023 MyVoice: Arabic Speech Resource Collaboration Platform Interspeech 2023 NAPReg: Nouns As Proxies Regularization for Semantically Aware Cross-Modal Embeddings WACV 2023 NaQ: Leveraging Narrations As Queries To Supervise Episodic Memory CVPR 2023 Natural Disaster Tweets Classification Using Multimodal Data EMNLP 2023 Natural Language-Assisted Sign Language Recognition CVPR 2023