multimodal learning

Spoken Moments: Learning Joint Audio-Visual Representations From Video Descriptions CVPR 2021 StacMR: Scene-Text Aware Cross-Modal Retrieval WACV 2021 Structured Co-reference Graph Attention for Video-grounded Dialogue AAAI 2021 Structured Scene Memory for Vision-Language Navigation CVPR 2021 STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding ICCV 2021 Synthesis of Compositional Animations From Textual Descriptions ICCV 2021 Systematic Generalization on gSCAN: What is Nearly Solved and What is Next? EMNLP 2021 TAP: Text-Aware Pre-Training for Text-VQA and Text-Caption CVPR 2021 TeachText: CrossModal Generalized Distillation for Text-Video Retrieval ICCV 2021 TediGAN: Text-Guided Diverse Face Image Generation and Manipulation CVPR 2021 Telling the What While Pointing to the Where: Multimodal Queries for Image Retrieval ICCV 2021 Temporal Cue Guided Video Highlight Detection With Low-Rank Audio-Visual Fusion ICCV 2021 Text2Mol: Cross-Modal Molecule Retrieval with Natural Language Queries EMNLP 2021 The Active Sensing Testbed AAAI 2021 The Boombox: Visual Reconstruction from Acoustic Vibrations CoRL 2021 The Laughing Machine: Predicting Humor in Video WACV 2021 There Is More Than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking With Sound by Distilling Multimodal Knowledge CVPR 2021 The Right To Talk: An Audio-Visual Transformer Approach ICCV 2021 The World of an Octopus: How Reporting Bias Influences a Language Model’s Perception of Color EMNLP 2021 TIME: Text and Image Mutual-Translation Adversarial Networks AAAI 2021 Towards Diverse Paragraph Captioning for Untrimmed Videos CVPR 2021 Towards More Flexible and Accurate Object Tracking With Natural Language: Algorithms and Benchmark CVPR 2021 Towards Multi-Modal Text-Image Retrieval to improve Human Reading NAACL 2021 Towards Sentiment and Emotion aided Multi-modal Speech Act Classification in Twitter NAACL 2021 Towards the Explainability of Multimodal Speech Emotion Recognition Interspeech 2021