Multimodal Learning

Y2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequences AAAI 2019 All-Neural Multi-Channel Speech Enhancement Interspeech 2018 A Probabilistic Model for Joint Learning of Word Embeddings from Texts and Images EMNLP 2018 Audio-visual Voice Conversion Using Deep Canonical Correlation Analysis for Deep Bottleneck Features Interspeech 2018 A Visual Attention Grounding Neural Model for Multimodal Machine Translation EMNLP 2018 Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets NAACL 2018 Bilinear Attention Networks NeurIPS 2018 Chain of Reasoning for Visual Question Answering NeurIPS 2018 Combining Character and Word Information in Neural Machine Translation Using a Multi-Level Attention NAACL 2018 Connecting Language and Vision to Actions ACL 2018 Contextual Inter-modal Attention for Multi-modal Sentiment Analysis EMNLP 2018 Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization NeurIPS 2018 Cross-lingual Decompositional Semantic Parsing EMNLP 2018 Cross-Modal Deep Variational Hand Pose Estimation CVPR 2018 CUNI System for the WMT18 Multimodal Translation Task EMNLP 2018 Deep Cross-Media Knowledge Transfer CVPR 2018 Deep Learning Based Multi-modal Addressee Recognition in Visual Scenes with Utterances IJCAI 2018 Deep Models of Interactions Across Sets ICML 2018 DNN Multimodal Fusion Techniques for Predicting Video Sentiment ACL 2018 Do Neural Network Cross-Modal Mappings Really Bridge Modalities? ACL 2018 Efficient Low-rank Multimodal Fusion With Modality-Specific Factors ACL 2018 End-to-End Dense Video Captioning With Masked Transformer CVPR 2018 End-to-end Image Captioning Exploits Distributional Similarity in Multimodal Space EMNLP 2018 Ensemble Sequence Level Training for Multimodal MT: OSU-Baidu WMT18 Multimodal Machine Translation System Report EMNLP 2018 Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrieval ACL 2018