← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

VLStereoSet: A Study of Stereotypical Bias in Pre-trained Vision-Language Models AACL 2022
Modality-specific Learning Rates for Effective Multimodal Additive Late-fusion ACL 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language ICML 2022
3MASSIV: Multilingual, Multimodal and Multi-Aspect Dataset of Social Media Short Videos CVPR 2022
Boosting 3D Object Detection by Simulating Multimodality on Point Clouds CVPR 2022
Incorporating Stock Market Signals for Twitter Stance Detection ACL 2022
Neuro-Symbolic Visual Dialog COLING 2022
Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis ACL 2022
Scaling Up Vision-Language Pre-Training for Image Captioning CVPR 2022
AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistant EMNLP 2022
DUCS at SemEval-2022 Task 6: Exploring Emojis and Sentiments for Sarcasm Detection NAACL 2022
Reading To Listen at the Cocktail Party: Multi-Modal Speech Separation CVPR 2022
MERLOT Reserve: Neural Script Knowledge Through Vision and Language and Sound CVPR 2022
Multimodal Argument Mining: A Case Study in Political Debates COLING 2022
FLAVA: A Foundational Language and Vision Alignment Model CVPR 2022
What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge ACL 2022
V2C: Visual Voice Cloning CVPR 2022
Multimodal Sarcasm Target Identification in Tweets ACL 2022
An Empirical Study of Training End-to-End Vision-and-Language Transformers CVPR 2022
Clean Text and Full-Body Transformer: Microsoft’s Submission to the WMT22 Shared Task on Sign Language Translation EMNLP 2022
ContIG: Self-Supervised Multimodal Contrastive Learning for Medical Imaging With Genetics CVPR 2022
Learning Program Representations for Food Images and Cooking Recipes CVPR 2022
MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-Based Visual Question Answering CVPR 2022
LaTr: Layout-Aware Transformer for Scene-Text VQA CVPR 2022
Probing Cross-modal Semantics Alignment Capability from the Textual Perspective EMNLP 2022