conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding EMNLP 2022
Self-supervised Representation Fusion for Speech and Wearable Based Emotion Recognition INTERSPEECH 2022
Improving Speech Emotion Recognition Using Self-Supervised Learning with Domain-Specific Audiovisual Tasks INTERSPEECH 2022
Multi-Modal Multi-Correlation Learning for Audio-Visual Speech Separation INTERSPEECH 2022
Are Multimodal Transformers Robust to Missing Modality? CVPR 2022
MNSRNet: Multimodal Transformer Network for 3D Surface Super-Resolution CVPR 2022
Vision-and-Language Pretrained Models: A Survey IJCAI 2022
Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis INTERSPEECH 2022
Exploiting Fine-tuning of Self-supervised Learning Models for Improving Bi-modal Sentiment Analysis and Emotion Recognition INTERSPEECH 2022
Improving Spoken Language Understanding with Cross-Modal Contrastive Learning INTERSPEECH 2022
Visually-aware Acoustic Event Detection using Heterogeneous Graphs INTERSPEECH 2022
Extending Compositional Attention Networks for Social Reasoning in Videos INTERSPEECH 2022
MedCLIP: Contrastive Learning from Unpaired Medical Images and Text EMNLP 2022
MCSE: Multimodal Contrastive Learning of Sentence Embeddings NAACL 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation ICML 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022
Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination EMNLP 2022
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts ICML 2022
Interact Before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition CVPR 2022
VisualGPT: Data-Efficient Adaptation of Pretrained Language Models for Image Captioning CVPR 2022
Generating Diverse and Natural 3D Human Motions From Text CVPR 2022
V-Doc: Visual Questions Answers With Documents CVPR 2022
Make It Move: Controllable Image-to-Video Generation With Text Descriptions CVPR 2022
Kernel Multimodal Continuous Attention NIPS 2022
Deep Multi-Modal Structural Equations For Causal Effect Estimation With Unstructured Proxies NIPS 2022