multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

Probing Contextual Language Models for Common Ground with Visual Representations NAACL 2021

In Factuality: Efficient Integration of Relevant Facts for Visual Question Answering IJCNLP 2021

Learning Temporal Dynamics From Cycles in Narrated Video ICCV 2021

Alpha at SemEval-2021 Task 6: Transformer Based Propaganda Classification SEMEVAL 2021

Localize to Binauralize: Audio Spatialization From Visual Sound Source Localization ICCV 2021

Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive Learning NIPS 2021

Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval ICCV 2021

1213Li at SemEval-2021 Task 6: Detection of Propaganda with Multi-modal Attention and Pre-trained Models SEMEVAL 2021

Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-Modal Pretraining ICCV 2021

Free-Form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloud ICCV 2021

Learn-To-Race: A Multimodal Control Environment for Autonomous Racing ICCV 2021

Human-Adversarial Visual Question Answering NIPS 2021

A Grounded Well-being Conversational Agent with Multiple Interaction Modes: Preliminary Results ACL 2021

NLyticsFKIE at SemEval-2021 Task 6: Detection of Persuasion Techniques In Texts And Images SEMEVAL 2021

MinD at SemEval-2021 Task 6: Propaganda Detection using Transfer Learning and Multimodal Fusion ACL 2021

A recipe for annotating grounded clarifications NAACL 2021

Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering ACL 2021

A First Look: Towards Explainable TextVQA Models via Visual and Textual Explanations NAACL 2021

Leveraging Partial Dependency Trees to Control Image Captions NAACL 2021

Episodic Transformer for Vision-and-Language Navigation ICCV 2021

Joint Audio-Visual Deepfake Detection ICCV 2021

Contrastive Multimodal Fusion With TupleInfoNCE ICCV 2021

The Right To Talk: An Audio-Visual Transformer Approach ICCV 2021

PhotoChat: A Human-Human Dialogue Dataset With Photo Sharing Behavior For Joint Image-Text Modeling ACL 2021

Structured Co-reference Graph Attention for Video-grounded Dialogue AAAI 2021