Skip to content
conftrace_

multimodal alignment

89 papers

Papers

Zero-Shot Defense Against Toxic Images via Inherent Multimodal Alignment in LVLMs EMNLP 2025 An eye for an ear: zero-shot audio description leveraging an image captioner with audio-visual token distribution matching NeurIPS 2024 A Touch, Vision, and Language Dataset for Multimodal Alignment ICML 2024 Bias-Conflict Sample Synthesis and Adversarial Removal Debias Strategy for Temporal Sentence Grounding in Video AAAI 2024 CAD - Contextual Multi-Modal Alignment for Dynamic AVQA WACV 2024 Event Causality Is Key to Computational Story Understanding NAACL 2024 Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning NeurIPS 2024 HEMM: Holistic Evaluation of Multimodal Foundation Models NeurIPS 2024 HyDiscGAN: A Hybrid Distributed cGAN for Audio-Visual Privacy Preservation in Multimodal Sentiment Analysis IJCAI 2024 IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos NeurIPS 2024 L4D-Track: Language-to-4D Modeling Towards 6-DoF Tracking and Shape Reconstruction in 3D Point Cloud Stream CVPR 2024 MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer CVPR 2024 MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension EMNLP 2024 Mitigating Object Hallucination via Concentric Causal Attention NeurIPS 2024 Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models ACL 2024 OneLLM: One Framework to Align All Modalities with Language CVPR 2024 Rainbow - A Benchmark for Systematic Testing of How Sensitive Visio-Linguistic Models are to Color Naming EACL 2024 Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language CVPR 2024 SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment ICML 2024 The Revolution of Multimodal Large Language Models: A Survey ACL 2024 UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All CVPR 2024 What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language models ACL 2024 World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering EMNLP 2024 Aligning Step-by-Step Instructional Diagrams to Video Demonstrations CVPR 2023 BridgeTower: Building Bridges between Encoders in Vision-Language Representation Learning AAAI 2023