Multimodal Learning

Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities EMNLP 2022 Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization ICML 2022 Mix and Localize: Localizing Sound Sources in Mixtures CVPR 2022 MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences EMNLP 2022 MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities ACL 2022 MMT: Multi-way Multi-modal Transformer for Multimodal Learning IJCAI 2022 Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-identification AAAI 2022 Modality-Agnostic Learning for Radar-Lidar Fusion in Vehicle Detection CVPR 2022 Modality-specific Learning Rates for Effective Multimodal Additive Late-fusion ACL 2022 Modeling Motion With Multi-Modal Features for Text-Based Video Segmentation CVPR 2022 Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022 Monocular Camera-Based Point-Goal Navigation by Learning Depth Channel and Cross-Modality Pyramid Fusion AAAI 2022 More Than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech CVPR 2022 MoSE: Modality Split and Ensemble for Multimodal Knowledge Graph Completion EMNLP 2022 mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections EMNLP 2022 mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensors NeurIPS 2022 MSCTD: A Multimodal Sentiment Chat Translation Dataset ACL 2022 M-SENA: An Integrated Platform for Multimodal Sentiment Analysis ACL 2022 MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection CVPR 2022 MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-Based Visual Question Answering CVPR 2022 Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts ICML 2022 Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning NeurIPS 2022 Multi-Head Modularization to Leverage Generalization Capability in Multi-Modal Networks AAAI 2022 Multi-Lingual Acquisition on Multimodal Pre-training for Cross-modal Retrieval NeurIPS 2022 Multilingual Multimodal Learning with Machine Translated Text EMNLP 2022