Multimodal Learning

Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithms NeurIPS 2024 AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera Joint Synthesis CVPR 2024 Alpha-CLIP: A CLIP Model Focusing on Wherever You Want CVPR 2024 AlterMOMA: Fusion Redundancy Pruning for Camera-LiDAR Fusion Models with Alternative Modality Masking NeurIPS 2024 A More Efficient Inference Model for Multimodal Emotion Recognition ACML 2024 An eye for an ear: zero-shot audio description leveraging an image captioner with audio-visual token distribution matching NeurIPS 2024 Animal-Bench: Benchmarking Multimodal Video Models for Animal-centric Video Understanding NeurIPS 2024 Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation CVPR 2024 ArtQuest: Countering Hidden Language Biases in ArtVQA WACV 2024 Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability ACL 2024 Audio-Visual Segmentation via Unlabeled Frame Exploitation CVPR 2024 Augment the Pairs: Semantics-Preserving Image-Caption Pair Augmentation for Grounding-Based Vision and Language Models WACV 2024 AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models EMNLP 2024 Benchmarking Out-of-Distribution Detection in Visual Question Answering WACV 2024 Benchmarking Visually-Situated Translation of Text in Natural Images EMNLP 2024 Beyond Entities: A Large-Scale Multi-Modal Knowledge Graph with Triplet Fact Grounding AAAI 2024 Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detection NeurIPS 2024 Beyond Fusion: Modality Hallucination-Based Multispectral Fusion for Pedestrian Detection WACV 2024 Beyond Text: Frozen Large Language Models in Visual Signal Comprehension CVPR 2024 Binding Touch to Everything: Learning Unified Multimodal Tactile Representations CVPR 2024 Boosting Textural NER with Synthetic Image and Instructive Alignment ACL 2024 Bridge the Modality and Capability Gaps in Vision-Language Model Selection NeurIPS 2024 Bridging the Gap between 2D and 3D Visual Question Answering: A Fusion Approach for 3D VQA AAAI 2024 Bridging the Semantic Latent Space between Brain and Machine: Similarity Is All You Need AAAI 2024 Bring Event into RGB and LiDAR: Hierarchical Visual-Motion Fusion for Scene Flow CVPR 2024