Multimodal NLP

Visually Grounded Reasoning across Languages and Cultures EMNLP 2021 ActBERT: Learning Global-Local Video-Text Representations CVPR 2020 “Did you really mean what you said?” : Sarcasm Detection in Hindi-English Code-Mixed Data using Bilingual Word Embeddings EMNLP 2020 Domain-Specific Lexical Grounding in Noisy Visual-Textual Documents EMNLP 2020 Modelling Form-Meaning Systematicity with Linguistic and Visual Features AAAI 2020 Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning Interspeech 2020 Referring Image Segmentation via Cross-Modal Progressive Comprehension CVPR 2020 The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents ACL 2020 Visually Grounded Continual Learning of Compositional Phrases EMNLP 2020 Grounded Word Sense Translation NAACL 2019 Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts EMNLP 2019 Multimodal, Multilingual Grapheme-to-Phoneme Conversion for Low-Resource Languages EMNLP 2019 A Probabilistic Model for Joint Learning of Word Embeddings from Texts and Images EMNLP 2018 Grounding language acquisition by training semantic parsers using captioned videos EMNLP 2018 Multimodal News Article Analysis IJCAI 2017 A Bilingual Attention Network for Code-switched Emotion Prediction COLING 2016 From phonemes to images: levels of representation in a recurrent neural model of visually-grounded language learning COLING 2016