conftrace_

multimodal representation

90 papers

Explore in graph

Co-occurring keywords

multimodal learning (4645) contrastive learning (4032) vision-language model (2348) representation learning (6206) self-supervised learning (3777) zero-shot learning (3650) cross-modal retrieval (351) large language model (13587) multimodal representation learning (24) clip model (218)

Papers

RoCBert: Robust Chinese Bert with Multimodal Contrastive Pretraining ACL 2022
Assessing Multilingual Fairness in Pre-trained Multimodal Representations ACL 2022
Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feeding CORL 2022
Hierarchical Processing of Visual and Language Information in the Brain AACL 2022
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching NIPS 2022
Divert More Attention to Vision-Language Tracking NIPS 2022
Mix and Localize: Localizing Sound Sources in Mixtures CVPR 2022
Mutual Information Divergence: A Unified Metric for Multimodal Generative Models NIPS 2022
UniCLIP: Unified Framework for Contrastive Language-Image Pre-training NIPS 2022
Conditioned Masked Language and Image Modeling for Image-Text Dense Retrieval EMNLP 2022
Multimodal Conversational AI: A Survey of Datasets and Approaches ACL 2022
MM-GATBT: Enriching Multimodal Representation Using Graph Attention Network NAACL 2022
Geometric Multimodal Contrastive Representation Learning ICML 2022
End-to-End Unsupervised Vision-and-Language Pre-training with Referring Expression Matching EMNLP 2022
T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation EMNLP 2022
Video and Text Matching With Conditioned Embeddings WACV 2022
Efficient Multilingual Multi-modal Pre-training through Triple Contrastive Loss COLING 2022
Are Vision-Language Transformers Learning Multimodal Representations? A Probing Perspective AAAI 2022
Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIP AAAI 2022
Structure from Silence: Learning Scene Structure from Ambient Sound CORL 2021
Query Generation for Multimodal Documents EACL 2021
Towards Visual Question Answering on Pathology Images IJCNLP 2021
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search EMNLP 2021
Does Vision-and-Language Pretraining Improve Lexical Grounding? EMNLP 2021
An Unsupervised Sampling Approach for Image-Sentence Matching Using Document-level Structural Information AAAI 2021