Multimodal Learning

MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensing NeurIPS 2023 MMLung: Moving Closer to Practical Lung Health Estimation using Smartphones Interspeech 2023 MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering EMNLP 2023 MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System ACL 2023 MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision and Language Models & Tasks ACL 2023 mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations EMNLP 2023 MMTN: Multi-Modal Memory Transformer Network for Image-Report Consistent Medical Report Generation AAAI 2023 MMVAE+: Enhancing the Generative Quality of Multimodal VAEs without Compromises ICLR 2023 MNER-QG: An End-to-End MRC Framework for Multimodal Named Entity Recognition with Query Grounding AAAI 2023 Modality Mixer for Multi-Modal Action Recognition WACV 2023 Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts ICLR 2023 Modeling Stroke Mask for End-to-End Text Erasing WACV 2023 Modeling the Lighting in Scenes As Style for Auto White-Balance Correction WACV 2023 Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation ACL 2023 Models See Hallucinations: Evaluating the Factuality in Video Captioning EMNLP 2023 Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners CVPR 2023 Modularized Zero-shot VQA with Pre-trained Models ACL 2023 Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer Interspeech 2023 Modular Visual Question Answering via Code Generation ACL 2023 Module-wise Adaptive Distillation for Multimodality Foundation Models NeurIPS 2023 MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter EMNLP 2023 MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videos ICCV 2023 MoqaGPT : Zero-Shot Multi-modal Open-domain Question Answering with Large Language Model EMNLP 2023 More Than Just Attention: Improving Cross-Modal Attentions With Contrastive Constraints for Image-Text Matching WACV 2023 MotionGPT: Human Motion as a Foreign Language NeurIPS 2023