multimodal representation

Multichannel AV-wav2vec2: A Framework for Learning Multichannel Multi-Modal Speech Representation AAAI 2024 Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language CVPR 2024 Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-Modal Structured Representations AAAI 2024 UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All CVPR 2024 CALIP: Zero-Shot Enhancement of CLIP with Parameter-Free Attention AAAI 2023 ConFEDE: Contrastive Feature Decomposition for Multimodal Sentiment Analysis ACL 2023 Contrastive Audio-Visual Masked Autoencoder ICLR 2023 Cross-Modal Translation and Alignment for Survival Analysis ICCV 2023 CrysMMNet: Multimodal Representation for Crystal Property Prediction UAI 2023 EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone ICCV 2023 Factorized Contrastive Learning: Going Beyond Multi-view Redundancy NeurIPS 2023 HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training ICCV 2023 ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning ACL 2023 MEDIMP: 3D Medical Images and clinical Prompts for renal transplant representation learning MIDL 2023 MultiZoo and MultiBench: A Standardized Toolkit for Multimodal Deep Learning JMLR 2023 Progressive Video Summarization via Multimodal Self-Supervised Learning WACV 2023 Prompt Switch: Efficient CLIP Adaptation for Text-Video Retrieval ICCV 2023 RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Search IJCAI 2023 Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokens CVPR 2023 Sentiment Knowledge Enhanced Self-supervised Learning for Multimodal Sentiment Analysis ACL 2023 SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-Training ICCV 2023 Unifying Vision-Language Representation Space with Single-Tower Transformer AAAI 2023 Visual Explanations of Image-Text Representations via Multi-Modal Information Bottleneck Attribution NeurIPS 2023 Are Vision-Language Transformers Learning Multimodal Representations? A Probing Perspective AAAI 2022 Assessing Multilingual Fairness in Pre-trained Multimodal Representations ACL 2022