cross-modal interaction

Entity-level Interaction via Heterogeneous Graph for Multimodal Named Entity Recognition EMNLP 2022 Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features EMNLP 2022 Interact Before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition CVPR 2022 Interact, Embed, and EnlargE: Boosting Modality-Specific Representations for Multi-Modal Person Re-identification AAAI 2022 Memory-Guided Semantic Learning Network for Temporal Sentence Grounding AAAI 2022 Noise-robust Cross-modal Interactive Learning with Text2Image Mask for Multi-modal Neural Machine Translation COLING 2022 Video as Conditional Graph Hierarchy for Multi-Granular Question Answering AAAI 2022 Vision-Language Pre-Training for Boosting Scene Text Detectors CVPR 2022 Locate Then Segment: A Strong Pipeline for Referring Image Segmentation CVPR 2021 Multimodal Sentiment Analysis with Temporal Modality Attention Interspeech 2021 Point-of-Interest Type Prediction using Text and Images EMNLP 2021 Relation-aware Video Reading Comprehension for Temporal Language Grounding EMNLP 2021 Repetitive Activity Counting by Sight and Sound CVPR 2021 Structured Multi-Level Interaction Network for Video Moment Localization via Language Query CVPR 2021 Cross-Interaction Hierarchical Attention Networks for Urban Anomaly Prediction IJCAI 2020 Does my multimodal model learn cross-modal interactions? It’s harder to tell than you might think! EMNLP 2020 Reasoning Step-by-Step: Temporal Sentence Localization in Videos via Deep Rectification-Modulation Network COLING 2020 Learning Factorized Multimodal Representations ICLR 2019 Multimodal Language Analysis with Recurrent Multistage Fusion EMNLP 2018 Temporally Grounding Natural Sentence in Video EMNLP 2018 MDL-CW: A Multimodal Deep Learning Framework With Cross Weights CVPR 2016