Multimodal Learning

TiMix: Text-Aware Image Mixing for Effective Vision-Language Pre-training AAAI 2024 TinyChart: Efficient Chart Understanding with Program-of-Thoughts Learning and Visual Token Merging EMNLP 2024 TOP-ReID: Multi-Spectral Object Re-identification with Token Permutation AAAI 2024 To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models EMNLP 2024 Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learning ECCV 2024 Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical Representation Learning NeurIPS 2024 Towards Artwork Explanation in Large-scale Vision Language Models ACL 2024 Towards Difficulty-Agnostic Efficient Transfer Learning for Vision-Language Models EMNLP 2024 Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning AAAI 2024 Towards Efficient Visual-Language Alignment of the Q-Former for Visual Reasoning Tasks EMNLP 2024 Towards Holistic, Pragmatic and Multimodal Conversational Systems AAAI 2024 Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale EMNLP 2024 Towards Language-Driven Video Inpainting via Multimodal Large Language Models CVPR 2024 Towards Low-Resource Harmful Meme Detection with LMM Agents EMNLP 2024 Towards Modern Image Manipulation Localization: A Large-Scale Dataset and Novel Methods CVPR 2024 Towards More Unified In-context Visual Understanding CVPR 2024 Towards Neuro-Symbolic Video Understanding ECCV 2024 Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approach CVPR 2024 Towards Robust Multimodal Sentiment Analysis with Incomplete Data NeurIPS 2024 Towards Visual Text Design Transfer Across Languages NeurIPS 2024 Training-free Deep Concept Injection Enables Language Models for Video Question Answering EMNLP 2024 Transcriptomics-guided Slide Representation Learning in Computational Pathology CVPR 2024 TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation ACL 2024 TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation NeurIPS 2024 TSMCR: Two-stage Supervised Multi-modality Contrastive Representation for Ultrasound-based Breast Cancer Diagnosis ACML 2024