multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation ACL 2021

Self-supervised Pre-training and Contrastive Representation Learning for Multiple-choice Video QA AAAI 2021

ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces AAAI 2021

Dynamic Graph Representation Learning for Video Dialog via Multi-Modal Shuffled Transformers AAAI 2021

FIXMYPOSE: Pose Correctional Captioning and Retrieval AAAI 2021

Humor Knowledge Enriched Transformer for Understanding Multimodal Humor AAAI 2021

Modality-specific Distillation NAACL 2021

A Package for Learning on Tabular and Text Data with Transformers NAACL 2021

News Content Completion with Location-Aware Image Selection AAAI 2021

FL-MSRE: A Few-Shot Learning based Approach to Multimodal Social Relation Extraction AAAI 2021

Learning Intuitive Physics with Multimodal Generative Models AAAI 2021

Attention Bottlenecks for Multimodal Fusion NIPS 2021

Debiased Visual Question Answering from Feature and Sample Perspectives NIPS 2021

Grounding Language to Entities and Dynamics for Generalization in Reinforcement Learning ICML 2021

Transductive Visual Verb Sense Disambiguation WACV 2021

Recognizing Multimodal Entailment IJCNLP 2021

PhotoChat: A Human-Human Dialogue Dataset With Photo Sharing Behavior For Joint Image-Text Modeling IJCNLP 2021

Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data IJCNLP 2021

Competence-based Multimodal Curriculum Learning for Medical Report Generation IJCNLP 2021

Control Image Captioning Spatially and Temporally IJCNLP 2021

M-GCN: A Multimodal Graph Convolutional Network to Integrate Functional and Structural Connectomics Data to Predict Multidimensional Phenotypic Characterizations MIDL 2021

UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning IJCNLP 2021

Exploiting Image–Text Synergy for Contextual Image Captioning EACL 2021

Dependency Induction Through the Lens of Visual Perception CONLL 2021

Adaptive Fusion Techniques for Multimodal Data EACL 2021