Multimodal Learning

Sub-Instruction Aware Vision-and-Language Navigation EMNLP 2020 Swoosh! Rattle! Thump! - Actions that Sound RSS 2020 Telling Left From Right: Learning Spatial Correspondence of Sight and Sound CVPR 2020 They Are Not All Alike: Answering Different Spatial Questions Requires Different Grounding Strategies EMNLP 2020 VD-BERT: A Unified Vision and Dialog Transformer with BERT EMNLP 2020 Video Object Grounding Using Semantic Roles in Language Description CVPR 2020 ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT EMNLP 2020 Visually Grounded Continual Learning of Compositional Phrases EMNLP 2020 Visual Objects As Context: Exploiting Visual Objects for Lexical Entailment EMNLP 2020 Visual-Semantic Matching by Exploring High-Order Attention and Distraction CVPR 2020 VQA With No Questions-Answers Training CVPR 2020 What Does BERT with Vision Look At? ACL 2020 X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers EMNLP 2020 2.5D Visual Sound CVPR 2019 A Novel Framework for Robustness Analysis of Visual QA Models AAAI 2019 Answer Them All! Toward Universal Visual Question Answering Models CVPR 2019 Are You Looking? Grounding to Multiple Modalities in Vision-and-Language Navigation ACL 2019 A Strong and Robust Baseline for Text-Image Matching ACL 2019 Categorizing and Inferring the Relationship between the Text and Image of Twitter Posts ACL 2019 Connecting Touch and Vision via Cross-Modal Prediction CVPR 2019 Connective Cognition Network for Directional Visual Commonsense Reasoning NeurIPS 2019 Cross-channel Communication Networks NeurIPS 2019 Cross-Modal Self-Attention Network for Referring Image Segmentation CVPR 2019 Deep Multimodal Clustering for Unsupervised Audiovisual Learning CVPR 2019 Deep Multimodal Multilinear Fusion with High-order Polynomial Pooling NeurIPS 2019