Multimodal Learning

ReSTR: Convolution-Free Referring Image Segmentation Using Transformers CVPR 2022 SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval WACV 2022 Searching for fingerspelled content in American Sign Language ACL 2022 Self-supervised Cross-modal Pretraining for Speech Emotion Recognition and Sentiment Analysis EMNLP 2022 Sentiment and Emotion-Aware Multi-Modal Complaint Identification AAAI 2022 Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors ACL 2022 SoundDoA: Learn Sound Source Direction of Arrival and Semantics from Sound Raw Waveforms Interspeech 2022 Spatial-aware Speaker Diarizaiton for Multi-channel Multi-party Meeting Interspeech 2022 Syntactic Multi-view Learning for Open Information Extraction EMNLP 2022 Tencent-MVSE: A Large-Scale Benchmark Dataset for Multi-Modal Video Similarity Evaluation CVPR 2022 Text2Pos: Text-to-Point-Cloud Cross-Modal Localization CVPR 2022 TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages NAACL 2022 Towards Language-Free Training for Text-to-Image Generation CVPR 2022 Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition for Single and Muti-Person Video Interspeech 2022 Translation between Molecules and Natural Language EMNLP 2022 TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection EMNLP 2022 TWEETSPIN: Fine-grained Propaganda Detection in Social Media Using Multi-View Representations NAACL 2022 Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformation NAACL 2022 Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picture NeurIPS 2022 Using Multi-Encoder Fusion Strategies to Improve Personalized Response Selection COLING 2022 VGNMN: Video-grounded Neural Module Networks for Video-Grounded Dialogue Systems NAACL 2022 Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows COLING 2022 VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts NeurIPS 2022 Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality EMNLP 2022 WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Types ACL 2022