conftrace_

modality alignment

78 papers

Explore in graph

Co-occurring keywords

multimodal learning (4645) large language model (13587) contrastive learning (4032) representation learning (6206) multi-modal learning (1278) foundation model (735) vision-language model (2348) multimodal large language model (966) cross-modal learning (525) speech translation (416)

Papers

Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection EMNLP 2024
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model EMNLP 2024
ViT-Lens: Towards Omni-modal Representations CVPR 2024
LLMs Can Evolve Continually on Modality for $\mathbb{X}$-Modal Reasoning NIPS 2024
Harmonizing Visual Text Comprehension and Generation NIPS 2024
Modality Unifying Network for Visible-Infrared Person Re-Identification ICCV 2023
Cross-Category Highlight Detection via Feature Decomposition and Modality Alignment AAAI 2023
CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation ACL 2023
Understanding and Constructing Latent Modality Structures in Multi-Modal Representation Learning CVPR 2023
Training Transitive and Commutative Multimodal Transformers with LoReTTa NIPS 2023
Cross-Modality Earth Mover’s Distance for Visible Thermal Person Re-identification AAAI 2023
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities EMNLP 2023
Cross-modality Data Augmentation for End-to-End Sign Language Translation EMNLP 2023
Parameter-efficient Tuning of Large-scale Multimodal Foundation Model NIPS 2023
Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions EMNLP 2022
ADAPT: Vision-Language Navigation With Modality-Aligned Action Prompts CVPR 2022
MAESTRO: Matched Speech Text Representations through Modality Matching INTERSPEECH 2022
Demodalizing Face Recognition with Synthetic Samples AAAI 2021
ASMR: Learning Attribute-Based Person Search With Adaptive Semantic Margin Regularizer ICCV 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task IJCNLP 2021
Discover Cross-Modality Nuances for Visible-Infrared Person Re-Identification CVPR 2021
CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals IJCNLP 2021
Seeking the Shape of Sound: An Adaptive Framework for Learning Voice-Face Association CVPR 2021
CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals ACL 2021
Cross-Modality Relevance for Reasoning on Language and Vision ACL 2020