Multimodal Learning

MIMO-DoAnet: Multi-channel Input and Multiple Outputs DoA Network with Unknown Number of Sound Sources Interspeech 2022 Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization COLING 2022 Mind the gap: On the value of silence representations to lexical-based speech emotion recognition Interspeech 2022 Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning NeurIPS 2022 MiQA: A Benchmark for Inference on Metaphorical Questions AACL 2022 Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality AACL 2022 Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities EMNLP 2022 Mitra Behzadi at SemEval-2022 Task 5 : Multimedia Automatic Misogyny Identification method based on CLIP SemEval 2022 Mix and Localize: Localizing Sound Sources in Mixtures CVPR 2022 Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA EMNLP 2022 MLLP-VRAIN UPV systems for the IWSLT 2022 Simultaneous Speech Translation and Speech-to-Speech Translation tasks ACL 2022 MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences EMNLP 2022 MMAN: Metapath Based Multi-Level Graph Attention Networks for Heterogeneous Network Embedding (Student Abstract) AAAI 2022 MM-Claims: A Dataset for Multimodal Claim Detection in Social Media NAACL 2022 MMCoQA: Conversational Question Answering over Text, Tables, and Images ACL 2022 MMNet: Muscle Motion-Guided Network for Micro-Expression Recognition IJCAI 2022 MMT: Multi-way Multi-modal Transformer for Multimodal Learning IJCAI 2022 Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-identification AAAI 2022 Modality-Agnostic Learning for Radar-Lidar Fusion in Vehicle Detection CVPR 2022 Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval EMNLP 2022 Modeling Intensification for Sign Language Generation: A Computational Approach ACL 2022 Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis COLING 2022 Modeling Referential Gaze in Task-oriented Settings of Varying Referential Complexity AACL 2022 Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension ACL 2022 Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022