conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

Interpreting and Analysing CLIP's Zero-Shot Image Classification via Mutual Knowledge NIPS 2024
Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Model NIPS 2024
DanceCamera3D: 3D Camera Movement Synthesis with Music and Dance CVPR 2024
Learning Multimodal Behaviors from Scratch with Diffusion Policy Gradient NIPS 2024
FineCLIP: Self-distilled Region-based CLIP for Better Fine-grained Understanding NIPS 2024
A Cross-Attention Layer coupled with Multimodal Fusion Methods for Recognizing Depression from Spontaneous Speech INTERSPEECH 2024
CLIP in Mirror: Disentangling text from visual images through reflection NIPS 2024
Unified Generative and Discriminative Training for Multi-modal Large Language Models NIPS 2024
Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning NIPS 2024
Revisiting Few-Shot Object Detection with Vision-Language Models NIPS 2024
SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos CVPR 2024
MM-TTS: Multi-Modal Prompt Based Style Transfer for Expressive Text-to-Speech Synthesis AAAI 2024
ShareGPT4Video: Improving Video Understanding and Generation with Better Captions NIPS 2024
Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model NIPS 2024
BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learning CVPR 2024
TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment NIPS 2024
LLaNA: Large Language and NeRF Assistant NIPS 2024
Text360Nav: 360-Degree Image Captioning Dataset for Urban Pedestrians Navigation COLING 2024
TIGER: A Unified Generative Model Framework for Multimodal Dialogue Response Generation COLING 2024
QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition CVPR 2024
Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoning WACV 2024
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World CVPR 2024
Multimodal Graph Neural Architecture Search under Distribution Shifts AAAI 2024
CausalStock: Deep End-to-end Causal Discovery for News-driven Multi-stock Movement Prediction NIPS 2024
MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos CVPR 2024