Multimodal Learning

MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World CVPR 2024 Multi-Prompts Learning with Cross-Modal Alignment for Attribute-Based Person Re-identification AAAI 2024 Multi-Scale Representation Learning for Protein Fitness Prediction NeurIPS 2024 MULTISCRIPT: Multimodal Script Learning for Supporting Open Domain Everyday Tasks AAAI 2024 MultiSkill: Evaluating Large Multimodal Models for Fine-grained Alignment Skills EMNLP 2024 MultiStage Speech Bandwidth Extension with Flexible Sampling Rate Control Interspeech 2024 Multi-stream Information Fusion Framework for Emotional Support Conversation COLING 2024 Multi-Task Interactive Robot Fleet Learning with Visual World Models CoRL 2024 Multitask Vision-Language Prompt Tuning WACV 2024 MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models NeurIPS 2024 Multivariate Time Series Forecasting By Graph Attention Networks With Theoretical Guarantees AISTATS 2024 Multi-View Clustering by Inter-cluster Connectivity Guided Reward ICML 2024 Multi-View People Detection in Large Scenes via Supervised View-Wise Contribution Weighting AAAI 2024 MuseChat: A Conversational Music Recommendation System for Videos CVPR 2024 MusicFlow: Cascaded Flow Matching for Text Guided Music Generation ICML 2024 MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models IJCAI 2024 MusicRL: Aligning Music Generation to Human Preferences ICML 2024 MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response NAACL 2024 MuTox: Universal MUltilingual Audio-based TOXicity Dataset and Zero-shot Detector ACL 2024 MV-Adapter: Multimodal Video Transfer Learning for Video Text Retrieval CVPR 2024 MVBench: A Comprehensive Multi-modal Video Understanding Benchmark CVPR 2024 MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generation CVPR 2024 MVGamba: Unify 3D Content Generation as State Space Sequence Modeling NeurIPS 2024 MVP-Bench: Can Large Vision-Language Models Conduct Multi-level Visual Perception Like Humans? EMNLP 2024 My Climate Advisor: An Application of NLP in Climate Adaptation for Agriculture ACL 2024