← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

FigMemes: A Dataset for Figurative Language Identification in Politically-Opinionated Memes EMNLP 2022
Positional Encoding for Capturing Modality Specific Cadence for Emotion Detection INTERSPEECH 2022
MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding EMNLP 2022
Self-supervised Representation Fusion for Speech and Wearable Based Emotion Recognition INTERSPEECH 2022
Improving Speech Emotion Recognition Using Self-Supervised Learning with Domain-Specific Audiovisual Tasks INTERSPEECH 2022
Multi-Modal Multi-Correlation Learning for Audio-Visual Speech Separation INTERSPEECH 2022
Are Multimodal Transformers Robust to Missing Modality? CVPR 2022
MNSRNet: Multimodal Transformer Network for 3D Surface Super-Resolution CVPR 2022
Vision-and-Language Pretrained Models: A Survey IJCAI 2022
Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis INTERSPEECH 2022
Exploiting Fine-tuning of Self-supervised Learning Models for Improving Bi-modal Sentiment Analysis and Emotion Recognition INTERSPEECH 2022
Improving Spoken Language Understanding with Cross-Modal Contrastive Learning INTERSPEECH 2022
Visually-aware Acoustic Event Detection using Heterogeneous Graphs INTERSPEECH 2022
Extending Compositional Attention Networks for Social Reasoning in Videos INTERSPEECH 2022
MedCLIP: Contrastive Learning from Unpaired Medical Images and Text EMNLP 2022
MCSE: Multimodal Contrastive Learning of Sentence Embeddings NAACL 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation ICML 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022
Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination EMNLP 2022
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts ICML 2022
Interact Before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition CVPR 2022
VisualGPT: Data-Efficient Adaptation of Pretrained Language Models for Image Captioning CVPR 2022
Generating Diverse and Natural 3D Human Motions From Text CVPR 2022
V-Doc: Visual Questions Answers With Documents CVPR 2022
Make It Move: Controllable Image-to-Video Generation With Text Descriptions CVPR 2022