Multimodal Learning

MetaPortrait: Identity-Preserving Talking Head Generation With Fast Personalized Adaptation CVPR 2023 MethaneMapper: Spectral Absorption Aware Hyperspectral Transformer for Methane Detection CVPR 2023 Metric Multi-View Graph Clustering AAAI 2023 MGTCF: Multi-Generator Tropical Cyclone Forecasting with Heterogeneous Meteorological Data AAAI 2023 Miracle: Towards Personalized Dialogue Generation with Latent-Space Multiple Personal Attribute Control EMNLP 2023 MIR-GAN: Refining Frame-Level Modality-Invariant Representations with Adversarial Network for Audio-Visual Speech Recognition ACL 2023 MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation ACL 2023 MMG-Ego4D: Multimodal Generalization in Egocentric Action Recognition CVPR 2023 MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering EMNLP 2023 MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System ACL 2023 MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision and Language Models & Tasks ACL 2023 MMSpeech: Multi-modal Multi-task Encoder-Decoder Pre-training for speech recognition Interspeech 2023 MMST-ViT: Climate Change-aware Crop Yield Prediction via Multi-Modal Spatial-Temporal Vision Transformer ICCV 2023 MMTN: Multi-Modal Memory Transformer Network for Image-Report Consistent Medical Report Generation AAAI 2023 MNER-QG: An End-to-End MRC Framework for Multimodal Named Entity Recognition with Query Grounding AAAI 2023 Mobile User Interface Element Detection via Adaptively Prompt Tuning CVPR 2023 Modality Mixer for Multi-Modal Action Recognition WACV 2023 MoDAR: Using Motion Forecasting for 3D Object Detection in Point Cloud Sequences CVPR 2023 Modeling Entities As Semantic Points for Visual Information Extraction in the Wild CVPR 2023 Model-Internal Slot-triggered Biasing for Domain Expansion in Neural Transducer ASR Models Interspeech 2023 Movie101: A New Movie Understanding Benchmark ACL 2023 MPCHAT: Towards Multimodal Persona-Grounded Conversation ACL 2023 mRedditSum: A Multimodal Abstractive Summarization Dataset of Reddit Threads with Images EMNLP 2023 MSMDFusion: Fusing LiDAR and Camera at Multiple Scales With Multi-Depth Seeds for 3D Object Detection CVPR 2023 MTANet: Multi-band Time-frequency Attention Network for Singing Melody Extraction from Polyphonic Music Interspeech 2023