Multimodal Learning

What Makes A Good Story? Designing Composite Rewards for Visual Storytelling AAAI 2020 What Makes Training Multi-Modal Classification Networks Hard? CVPR 2020 When is a bishop not like a rook? When it’s like a rabbi! Multi-prototype BERT embeddings for estimating semantic relationships CoNLL 2020 Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements EMNLP 2020 WISE: Word-Level Interaction-Based Multimodal Fusion for Speech Emotion Recognition Interspeech 2020 Wish You Were Here: Context-Aware Human Generation CVPR 2020 Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison WACV 2020 Words Aren’t Enough, Their Order Matters: On the Robustness of Grounding Visual Referring Expressions ACL 2020 Worse WER, but Better BLEU? Leveraging Word Embedding as Intermediate in Multitask End-to-End Speech Translation ACL 2020 xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation CVPR 2020 YNU-HPCC at SemEval-2020 Task 8: Using a Parallel-Channel Model for Memotion Analysis SemEval 2020 YNU-oxz at SemEval-2020 Task 5: Detecting Counterfactuals Based on Ordered Neurons LSTM and Hierarchical Attention Network SemEval 2020 ZEST: Zero-shot Learning from Text Descriptions using Textual Similarity and Visual Summarization EMNLP 2020 ACMM: Aligned Cross-Modal Memory for Few-Shot Image and Sentence Matching ICCV 2019 A Computational Model of Early Language Acquisition from Audiovisual Experiences of Young Infants Interspeech 2019 A Corpus for Reasoning about Natural Language Grounded in Photographs ACL 2019 Acoustic and Articulatory Feature Based Speech Rate Estimation Using a Convolutional Dense Neural Network Interspeech 2019 Active Learning for Deep Detection Neural Networks ICCV 2019 Active Learning for Domain Classification in a Commercial Spoken Personal Assistant Interspeech 2019 Actively Seeking and Learning From Live Data CVPR 2019 Adapting BERT for Target-Oriented Multimodal Sentiment Classification IJCAI 2019 Adaptive Cross-Modal Few-shot Learning NeurIPS 2019 A Deep Generative Model for Code Switched Text IJCAI 2019 A Deep Sequential Model for Discourse Parsing on Multi-Party Dialogues AAAI 2019 Adversarial Learning for Weakly-Supervised Social Network Alignment AAAI 2019