Skip to content
conftrace_

modality alignment

82 papers

Explore in graph

Co-occurring keywords · papers mentioning both

multimodal learning (28) large language model (12) contrastive learning (11) representation learning (10) vision-language model (8) foundation model (6) multimodal large language model (6) person re-identification (6) cross-modal learning (6) speech translation (4)

Papers

Dynamic Weighted Combiner for Mixed-Modal Image Retrieval AAAI 2024 Harmonizing Visual Text Comprehension and Generation NeurIPS 2024 LLMs Can Evolve Continually on Modality for X-Modal Reasoning NeurIPS 2024 MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Models SemEval 2024 Modality-Aware Representation Learning for Zero-Shot Sketch-Based Image Retrieval WACV 2024 Multi-Level Cross-Modal Alignment for Speech Relation Extraction EMNLP 2024 OneLLM: One Framework to Align All Modalities with Language CVPR 2024 Pushing the Limits of Zero-shot End-to-End Speech Translation ACL 2024 Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment NeurIPS 2024 Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysis NeurIPS 2024 ViT-Lens: Towards Omni-modal Representations CVPR 2024 CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation ACL 2023 Cross-Category Highlight Detection via Feature Decomposition and Modality Alignment AAAI 2023 Cross-modality Data Augmentation for End-to-End Sign Language Translation EMNLP 2023 Cross-Modality Earth Mover’s Distance for Visible Thermal Person Re-identification AAAI 2023 Modality Unifying Network for Visible-Infrared Person Re-Identification ICCV 2023 Parameter-efficient Tuning of Large-scale Multimodal Foundation Model NeurIPS 2023 SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities EMNLP 2023 Training Transitive and Commutative Multimodal Transformers with LoReTTa NeurIPS 2023 Understanding and Constructing Latent Modality Structures in Multi-Modal Representation Learning CVPR 2023 ADAPT: Vision-Language Navigation With Modality-Aligned Action Prompts CVPR 2022 Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions EMNLP 2022 MAESTRO: Matched Speech Text Representations through Modality Matching Interspeech 2022 ASMR: Learning Attribute-Based Person Search With Adaptive Semantic Margin Regularizer ICCV 2021 CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals ACL 2021