conftrace_
← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classification CVPR 2023
Context-Aware Alignment and Mutual Masking for 3D-Language Pre-Training CVPR 2023
Depth Estimation From Camera Image and mmWave Radar Point Cloud CVPR 2023
Vision Transformers Are Parameter-Efficient Audio-Visual Learners CVPR 2023
Music-Driven Group Choreography CVPR 2023
AVFormer: Injecting Vision Into Frozen Speech Models for Zero-Shot AV-ASR CVPR 2023
Multi-Modal Representation Learning With Text-Driven Soft Masks CVPR 2023
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval? CVPR 2023
Modeling Entities As Semantic Points for Visual Information Extraction in the Wild CVPR 2023
PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detection CVPR 2023
Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text NIPS 2023
Multimodal Deep Learning Model Unveils Behavioral Dynamics of V1 Activity in Freely Moving Mice NIPS 2023
CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders NIPS 2023
Parameter-efficient Tuning of Large-scale Multimodal Foundation Model NIPS 2023
Incomplete Multimodality-Diffused Emotion Recognition NIPS 2023
Improving multimodal datasets with image captioning NIPS 2023
Connecting Multi-modal Contrastive Representations NIPS 2023
ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab NIPS 2023
Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile NIPS 2023
Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio NIPS 2023
SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs NIPS 2023
Learning Unseen Modality Interaction NIPS 2023
A Theory of Multimodal Learning NIPS 2023
Language-based Action Concept Spaces Improve Video Self-Supervised Learning NIPS 2023
Injecting Multimodal Information into Rigid Protein Docking via Bi-level Optimization NIPS 2023