Multimodal Learning

MuEP: A Multimodal Benchmark for Embodied Planning with Foundation Models IJCAI 2024 Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA ACL 2024 Multi-Attribute Interactions Matter for 3D Visual Grounding CVPR 2024 MultiClimate: Multimodal Stance Detection on Climate Change Videos EMNLP 2024 MULTICOLLAB: A Multimodal Corpus of Dialogues for Analyzing Collaboration and Frustration in Language COLING 2024 Multi-Dimensional Insights: Annotated Dataset of Stance, Sentiment, and Emotion in Facebook Comments on Tunisia’s July 25 Measures COLING 2024 MuLTI: Efficient Video-and-Language Understanding with Text-Guided MultiWay-Sampler and Multiple Choice Modeling AAAI 2024 Multi-Factor Adaptive Vision Selection for Egocentric Video Question Answering ICML 2024 Multi-Fidelity Residual Neural Processes for Scalable Surrogate Modeling ICML 2024 Multi-Level Attention Aggregation for Language-Agnostic Speaker Replication EACL 2024 Multi-Level Cross-Modal Alignment for Speech Relation Extraction EMNLP 2024 Multi-level Disentangling Network for Cross-Subject Emotion Recognition Based on Multimodal Physiological Signals IJCAI 2024 Multilingual Diversity Improves Vision-Language Representations NeurIPS 2024 Multilingual Synopses of Movie Narratives: A Dataset for Vision-Language Story Understanding EMNLP 2024 Multilingual Turn-taking Prediction Using Voice Activity Projection COLING 2024 MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models MIDL 2024 Multimodal and Multilingual Laughter Detection in Stand-Up Comedy Videos COLING 2024 Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models ACL 2024 Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of Speech-Silence and Word-Punctuation Interspeech 2024 Multimodal Belief Prediction Interspeech 2024 Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection WACV 2024 Multimodal Chart Retrieval: A Comparison of Text, Table and Image Based Approaches NAACL 2024 Multimodal Contextual Dialogue Breakdown Detection for Conversational AI Models NAACL 2024 Multimodal Contextualized Semantic Parsing from Speech ACL 2024 Multimodal Cross-lingual Phrase Retrieval COLING 2024