← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

MovieQA: Understanding Stories in Movies Through Question-Answering CVPR 2016
Aggregating Image and Text Quantized Correlated Components CVPR 2016
Geometry-Informed Material Recognition CVPR 2016
Unsupervised Learning of Spoken Language with Visual Context NIPS 2016
Audio-Visual Speech Recognition Using Bimodal-Trained Bottleneck Features for a Person with Severe Hearing Loss INTERSPEECH 2016
Ask Me Anything: Free-Form Visual Question Answering Based on Knowledge From External Sources CVPR 2016
Generating Video Description using Sequence-to-sequence Model with Temporal Attention COLING 2016
Multimodal Mood Classification - A Case Study of Differences in Hindi and Western Songs COLING 2016
From phonemes to images: levels of representation in a recurrent neural model of visually-grounded language learning COLING 2016
Visually Indicated Sounds CVPR 2016
Temporal Multimodal Learning in Audiovisual Speech Recognition CVPR 2016
Is an Image Worth More than a Thousand Words? On the Fine-Grain Semantic Differences between Visual and Linguistic Representations COLING 2016
Cutting Edge: Soft Correspondences in Multimodal Scene Parsing ICCV 2015
Don't Just Listen, Use Your Imagination: Leveraging Visual Common Sense for Non-Visual Tasks CVPR 2015
VisKE: Visual Knowledge Extraction and Question Answering by Visual Verification of Relation Phrases CVPR 2015
Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books ICCV 2015
Joint Photo Stream and Blog Post Summarization and Exploration CVPR 2015
Predicting Deep Zero-Shot Convolutional Neural Networks Using Textual Descriptions ICCV 2015
From Captions to Visual Concepts and Back CVPR 2015
MMSS: Multi-Modal Sharable and Specific Feature Learning for RGB-D Object Recognition ICCV 2015
Multimodal Convolutional Neural Networks for Matching Image and Sentence ICCV 2015
Sense Discovery via Co-Clustering on Images and Text CVPR 2015
Appearance-Based Gaze Estimation in the Wild CVPR 2015
Deep Visual-Semantic Alignments for Generating Image Descriptions CVPR 2015
Seeing What You're Told: Sentence-Guided Activity Recognition In Video CVPR 2014