conftrace_

multimodal representation learning

24 papers

Explore in graph

Co-occurring keywords

contrastive learning (4032) multimodal representation (90) multimodal learning (4645) representation learning (6206) missing modality (64) deep learning (2118) image-text retrieval (112) multimodal fusion (303) cross-modal interaction (66) image-text matching (137)

Papers

MAUGen: A Unified Diffusion Approach for Multi-Identity Facial Expression and AU Label Generation AAAI 2026
DALR: Dual-level Alignment Learning for Multimodal Sentence Representation Learning ACL 2025
CLIP-GS: Unifying Vision-Language Representation with 3D Gaussian Splatting ICCV 2025
Incorporating Dense Knowledge Alignment into Unified Multimodal Representation Models CVPR 2025
Multimodal Representation Learning by Alternating Unimodal Adaptation CVPR 2024
Efficient Vision-Language Pre-training by Cluster Masking CVPR 2024
Multi-Scale Representation Learning for Protein Fitness Prediction NIPS 2024
HEST-1k: A Dataset For Spatial Transcriptomics and Histology Image Analysis NIPS 2024
Multi-Modal Representation Learning With Text-Driven Soft Masks CVPR 2023
Enhanced Multimodal Representation Learning With Cross-Modal KD CVPR 2023
M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities AAAI 2023
Relaxing Contrastiveness in Multimodal Representation Learning WACV 2023
Improving CLIP Training with Language Rewrites NIPS 2023
Achieving Cross Modal Generalization with Multimodal Unified Representation NIPS 2023
Geometric Multimodal Contrastive Representation Learning ICML 2022
Multimodal Contrastive Learning via Uni-Modal Coding and Cross-Modal Prediction for Multimodal Sentiment Analysis EMNLP 2022
Visuo-Tactile Transformers for Manipulation CORL 2022
Unimodal and Crossmodal Refinement Network for Multimodal Sequence Fusion EMNLP 2021
GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-Efficient Medical Image Recognition ICCV 2021
An Unsupervised Sampling Approach for Image-Sentence Matching Using Document-level Structural Information AAAI 2021
BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection AAAI 2019
Multimodal Machine Learning: Integrating Language, Vision and Speech ACL 2017
MDL-CW: A Multimodal Deep Learning Framework With Cross Weights CVPR 2016
Improved Multimodal Deep Learning with Variation of Information NIPS 2014