← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

The Aligned Multimodal Movie Treebank: An audio, video, dependency-parse treebank EMNLP 2022
Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval EMNLP 2022
Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Prediction EMNLP 2022
Retrieval Augmented Visual Question Answering with Outside Knowledge EMNLP 2022
Dual-Key Multimodal Backdoors for Visual Question Answering CVPR 2022
ObjectFormer for Image Manipulation Detection and Localization CVPR 2022
Multimodal Conversational AI: A Survey of Datasets and Approaches ACL 2022
Utilizing Cross-Modal Contrastive Learning to Improve Item Categorization BERT Model ACL 2022
Fine-tuning and Sampling Strategies for Multimodal Role Labeling of Entities under Class Imbalance ACL 2022
DD-TIG at Constraint@ACL2022: Multimodal Understanding and Reasoning for Role Labeling of Entities in Hateful Memes ACL 2022
On the Complementarity of Images and Text for the Expression of Emotions in Social Media ACL 2022
Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checking EMNLP 2022
ARTIST: A Transformer-based Chinese Text-to-Image Synthesizer Digesting Linguistic and World Knowledge EMNLP 2022
MovieUN: A Dataset for Movie Understanding and Narrating EMNLP 2022
HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data ACL 2022
Learning Functional Distributional Semantics with Visual Data ACL 2022
VisualHow: Multimodal Problem Solving CVPR 2022
Dynamic Key-Value Memory Enhanced Multi-Step Graph Reasoning for Knowledge-Based Visual Question Answering AAAI 2022
Cross-Modal Coherence for Text-to-Image Retrieval AAAI 2022
Edge-Aware Guidance Fusion Network for RGB–Thermal Scene Parsing AAAI 2022
TTIC’s WMT-SLT 22 Sign Language Translation System EMNLP 2022
Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features EMNLP 2022
Ring That Bell: A Corpus and Method for Multimodal Metaphor Detection in Videos EMNLP 2022
Improving information fusion on multimodal clinical data in classification settings EMNLP 2022
Visual Grounding of Inter-lingual Word-Embeddings EMNLP 2022