Multimodal Learning

Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it? EMNLP 2021 TransFill: Reference-Guided Image Inpainting by Merging Multiple Color and Spatial Transformations CVPR 2021 Transitional Adaptation of Pretrained Models for Visual Storytelling CVPR 2021 Two-Stream Convolution Augmented Transformer for Human Activity Recognition AAAI 2021 UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training CVPR 2021 UFC-BERT: Unifying Multi-Modal Controls for Conditional Image Synthesis NeurIPS 2021 Unimodal and Crossmodal Refinement Network for Multimodal Sequence Fusion EMNLP 2021 UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning ACL 2021 VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text NeurIPS 2021 Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting CVPR 2021 Video Captioning of Future Frames WACV 2021 Video-guided Machine Translation with Spatial Hierarchical Attention Network ACL 2021 View-Guided Point Cloud Completion CVPR 2021 Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers EMNLP 2021 Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models EMNLP 2021 Visual Cues and Error Correction for Translation Robustness EMNLP 2021 Visual Goal-Step Inference using wikiHow EMNLP 2021 Visually Grounded Concept Composition EMNLP 2021 Visually Grounded Reasoning across Languages and Cultures EMNLP 2021 Visually Informed Binaural Audio Generation without Binaural Audios CVPR 2021 VisualMRC: Machine Reading Comprehension on Document Images AAAI 2021 Visual Relation Detection using Hybrid Analogical Learning AAAI 2021 VisualSparta: An Embarrassingly Simple Approach to Large-scale Text-to-Image Search with Weighted Bag-of-words ACL 2021 VisualVoice: Audio-Visual Speech Separation With Cross-Modal Consistency CVPR 2021 VL-BERT+: Detecting Protected Groups in Hateful Multimodal Memes ACL 2021