Multimodal Learning

CLIP-Driven Open-Vocabulary 3D Scene Graph Generation via Cross-Modality Contrastive Learning CVPR 2024 CLIP-Gaze: Towards General Gaze Estimation via Visual-Linguistic Model AAAI 2024 CLIP in Mirror: Disentangling text from visual images through reflection NeurIPS 2024 CoDi-2: In-Context Interleaved and Interactive Any-to-Any Generation CVPR 2024 CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Models ACL 2024 Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024 CoIN: A Benchmark of Continual Instruction Tuning for Multimodel Large Language Models NeurIPS 2024 CoLLaVO: Crayon Large Language and Vision mOdel ACL 2024 ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation ACL 2024 COMMA: Co-articulated Multi-Modal Learning AAAI 2024 Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction CVPR 2024 Complex Organ Mask Guided Radiology Report Generation WACV 2024 Composite Diffusion: whole >= Sparts WACV 2024 Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex Interactions AAAI 2024 Concept Weaver: Enabling Multi-Concept Fusion in Text-to-Image Models CVPR 2024 ConCon-Chi: Concept-Context Chimera Benchmark for Personalized Vision-Language Tasks CVPR 2024 Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment AAAI 2024 Connecting the Dots: Collaborative Fine-tuning for Black-Box Vision-Language Models ICML 2024 Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answering CVPR 2024 Constructing Concept-based Models to Mitigate Spurious Correlations with Minimal Human Effort ECCV 2024 CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models EMNLP 2024 Continual Audio-Visual Sound Separation NeurIPS 2024 Continual Multimodal Knowledge Graph Construction IJCAI 2024 Contrasting Multiple Representations with the Multi-Marginal Matching Gap ICML 2024 Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities NeurIPS 2024