Vision-Language Models

Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation EMNLP 2021 UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training CVPR 2021 VinVL: Revisiting Visual Representations in Vision-Language Models CVPR 2021 Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers EMNLP 2021 Visually Grounded Follow-up Questions: a Dataset of Spatial Questions Which Require Dialogue History ACL 2021 Visually Grounded Reasoning across Languages and Cultures EMNLP 2021 VisualSem: a high-quality knowledge graph for vision and language EMNLP 2021 VIVO: Visual Vocabulary Pre-Training for Novel Object Captioning AAAI 2021 Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation ACL 2021 12-in-1: Multi-Task Vision and Language Representation Learning CVPR 2020 AI Sensing for Robotics using Deep Learning based Visual and Language Modeling ACL 2020 Fine-Grained Video-Text Retrieval With Hierarchical Graph Reasoning CVPR 2020 Graph Structured Network for Image-Text Matching CVPR 2020 Image Search With Text Feedback by Visiolinguistic Attention Learning CVPR 2020 Large-Scale Adversarial Training for Vision-and-Language Representation Learning NeurIPS 2020 Learning User Representations for Open Vocabulary Image Hashtag Prediction CVPR 2020 MULE: Multimodal Universal Language Embedding AAAI 2020 The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents ACL 2020 They Are Not All Alike: Answering Different Spatial Questions Requires Different Grounding Strategies EMNLP 2020 Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training AAAI 2020 VL-BERT: Pre-training of Generic Visual-Linguistic Representations ICLR 2020 X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers EMNLP 2020 Auto-Encoding Scene Graphs for Image Captioning CVPR 2019 Connective Cognition Network for Directional Visual Commonsense Reasoning NeurIPS 2019 Faithful Multimodal Explanation for Visual Question Answering ACL 2019