conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

Depth Estimation From Camera Image and mmWave Radar Point Cloud CVPR 2023
Vision Transformers Are Parameter-Efficient Audio-Visual Learners CVPR 2023
Music-Driven Group Choreography CVPR 2023
AVFormer: Injecting Vision Into Frozen Speech Models for Zero-Shot AV-ASR CVPR 2023
Multi-Modal Representation Learning With Text-Driven Soft Masks CVPR 2023
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval? CVPR 2023
Modeling Entities As Semantic Points for Visual Information Extraction in the Wild CVPR 2023
PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detection CVPR 2023
Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text NIPS 2023
Multimodal Deep Learning Model Unveils Behavioral Dynamics of V1 Activity in Freely Moving Mice NIPS 2023
CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders NIPS 2023
Parameter-efficient Tuning of Large-scale Multimodal Foundation Model NIPS 2023
Incomplete Multimodality-Diffused Emotion Recognition NIPS 2023
Improving multimodal datasets with image captioning NIPS 2023
Connecting Multi-modal Contrastive Representations NIPS 2023
ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab NIPS 2023
Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile NIPS 2023
Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio NIPS 2023
SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs NIPS 2023
Learning Unseen Modality Interaction NIPS 2023
A Theory of Multimodal Learning NIPS 2023
Language-based Action Concept Spaces Improve Video Self-Supervised Learning NIPS 2023
Injecting Multimodal Information into Rigid Protein Docking via Bi-level Optimization NIPS 2023
OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents NIPS 2023
MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation NIPS 2023