Deep Learning

MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs NeurIPS 2024 MMGNN: A Molecular Merged Graph Neural Network for Explainable Solvation Free Energy Prediction IJCAI 2024 MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification EMNLP 2024 MMM: Generative Masked Motion Model CVPR 2024 MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generation NeurIPS 2024 MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI CVPR 2024 MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning CVPR 2024 MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts EMNLP 2024 MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance ICML 2024 MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding AAAI 2024 MMSite: A Multi-modal Framework for the Identification of Active Sites in Proteins NeurIPS 2024 MM-SOC: Benchmarking Multimodal Large Language Models in Social Media Platforms ACL 2024 MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos CVPR 2024 MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI ICML 2024 MM-TTS: Multi-Modal Prompt Based Style Transfer for Expressive Text-to-Speech Synthesis AAAI 2024 MMVQA: A Comprehensive Dataset for Investigating Multipage Multimodal Information Retrieval in PDF-based Visual Question Answering IJCAI 2024 MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset NeurIPS 2024 Mobile Attention: Mobile-Friendly Linear-Attention for Vision Transformers ICML 2024 MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training CVPR 2024 MobileInst: Video Instance Segmentation on the Mobile AAAI 2024 MobileNVC: Real-Time 1080p Neural Video Compression on a Mobile Device WACV 2024 Mobile PresenTra: NICT fast neural text-to-speech system on smartphones with incremental inference of MS-FC-HiFi-GAN for law-latency synthesis Interspeech 2024 MobileQuant: Mobile-friendly Quantization for On-device Language Models EMNLP 2024 MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech ACL 2024 MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding EMNLP 2024