Multimodal Learning

Browse and Concentrate: Comprehending Multimodal Content via Prior-LLM Context Fusion ACL 2024 C3Net: Compound Conditioned ControlNet for Multimodal Content Generation CVPR 2024 Can visual language models resolve textual ambiguity with visual cues? Let visual puns tell you! EMNLP 2024 ChartAssistant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning ACL 2024 ChatPose: Chatting about 3D Human Pose CVPR 2024 CLIPCEIL: Domain Generalization through CLIP via Channel rEfinement and Image-text aLignment NeurIPS 2024 CLIP in Mirror: Disentangling text from visual images through reflection NeurIPS 2024 Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024 ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation ACL 2024 CommVQA: Situating Visual Question Answering in Communicative Contexts EMNLP 2024 Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction CVPR 2024 ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualization NeurIPS 2024 Concept-skill Transferability-based Data Selection for Large Vision-Language Models EMNLP 2024 ConCon-Chi: Concept-Context Chimera Benchmark for Personalized Vision-Language Tasks CVPR 2024 Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Models NeurIPS 2024 Continual Vision-Language Retrieval via Dynamic Knowledge Rectification AAAI 2024 Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understanding CVPR 2024 Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions NeurIPS 2024 CrossMAE: Cross-Modality Masked Autoencoders for Region-Aware Audio-Visual Pre-Training CVPR 2024 Cross-Modal Match for Language Conditioned 3D Object Grounding AAAI 2024 Cyclic Learning for Binaural Audio Generation and Localization CVPR 2024 Decompose and Compare Consistency: Measuring VLMs’ Answer Reliability via Task-Decomposition Consistency Comparison EMNLP 2024 Deep Correlated Prompting for Visual Recognition with Missing Modalities NeurIPS 2024 DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs NeurIPS 2024 Deep Visual-Genetic Biometrics for Taxonomic Classification of Rare Species WACV 2024