multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

Inconsistency Matters: A Knowledge-guided Dual-inconsistency Network for Multi-modal Rumor Detection EMNLP 2021

Region under Discussion for visual dialog EMNLP 2021

Panoptic Narrative Grounding ICCV 2021

BERTGen: Multi-task Generation through BERT ACL 2021

Synthesis of Compositional Animations From Textual Descriptions ICCV 2021

Global Fusion Attention for Vision and Language Understanding (Student Abstract) AAAI 2021

TransVG: End-to-End Visual Grounding With Transformers ICCV 2021

CSECU-DSG at SemEval-2021 Task 6: Orchestrating Multimodal Neural Architectures for Identifying Persuasion Techniques in Texts and Images ACL 2021

Learning To Cut by Watching Movies ICCV 2021

Joint Visual and Audio Learning for Video Highlight Detection ICCV 2021

Attention Is Not Enough: Mitigating the Distribution Discrepancy in Asynchronous Multimodal Sequence Fusion ICCV 2021

Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction CVPR 2021

Cross-Modal Retrieval Augmentation for Multi-Modal Classification EMNLP 2021

Pano-AVQA: Grounded Audio-Visual Question Answering on 360deg Videos ICCV 2021

Multi-Scale Progressive Attention Network for Video Question Answering ACL 2021

Optimal Neural Program Synthesis from Multimodal Specifications EMNLP 2021

“I’ve Seen Things You People Wouldn’t Believe”: Hallucinating Entities in GuessWhat?! ACL 2021

How2Sign: A Large-Scale Multimodal Dataset for Continuous American Sign Language CVPR 2021

LapsCore: Language-Guided Person Search via Color Reasoning ICCV 2021

RGB-D Saliency Detection via Cascaded Mutual Information Minimization ICCV 2021

TIME: Text and Image Mutual-Translation Adversarial Networks AAAI 2021

Binaural Audio-Visual Localization AAAI 2021

MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records AAAI 2021

Attention-Based Cross-Modal Fusion for Audio-Visual Voice Activity Detection in Musical Video Streams INTERSPEECH 2021

Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- and Intra-modality Attention AAAI 2021