Multimodal Learning

Probing Synergistic High-Order Interaction in Infrared and Visible Image Fusion CVPR 2024 PromptAD: Zero-Shot Anomaly Detection Using Text Prompts WACV 2024 Prompt-Driven Referring Image Segmentation with Instance Contrasting CVPR 2024 Prompt Highlighter: Interactive Control for Multi-Modal LLMs CVPR 2024 Prompting Multi-Modal Image Segmentation with Semantic Grouping AAAI 2024 ProtT3: Protein-to-Text Generation for Text-based Protein Understanding ACL 2024 PTUS: Photo-Realistic Talking Upper-Body Synthesis via 3D-Aware Motion Decomposition Warping AAAI 2024 Putting the Object Back into Video Object Segmentation CVPR 2024 Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels ICML 2024 QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition CVPR 2024 Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models CVPR 2024 Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective EMNLP 2024 Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval EMNLP 2024 Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM EMNLP 2024 QUEST: Quadruple Multimodal Contrastive Learning with Constraints and Self-Penalization NeurIPS 2024 Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos CVPR 2024 Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoning WACV 2024 Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels CVPR 2024 RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Models NeurIPS 2024 READ-PVLA: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling AAAI 2024 Recognize Any Regions NeurIPS 2024 ReconBoost: Boosting Can Achieve Modality Reconcilement ICML 2024 RedCore: Relative Advantage Aware Cross-Modal Representation Learning for Missing Modalities with Imbalanced Missing Rates AAAI 2024 Referencing Where to Focus: Improving Visual Grounding with Referential Query NeurIPS 2024 Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation AAAI 2024