conftrace_
← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

MoReVQA: Exploring Modular Reasoning Models for Video Question Answering CVPR 2024
Prot2Text: Multimodal Protein’s Function Generation with GNNs and Transformers AAAI 2024
Well, Now We Know! Unveiling Sarcasm: Initiating and Exploring Multimodal Conversations with Reasoning AAAI 2024
LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model CVPR 2024
Beyond Aesthetics: Cultural Competence in Text-to-Image Models NIPS 2024
Improving Audio-Visual Segmentation with Bidirectional Generation AAAI 2024
AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis AAAI 2024
Modality-Collaborative Test-Time Adaptation for Action Recognition CVPR 2024
T-VSL: Text-Guided Visual Sound Source Localization in Mixtures CVPR 2024
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI NIPS 2024
Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakes NIPS 2024
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition CVPR 2024
What matters when building vision-language models? NIPS 2024
Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs NIPS 2024
Efficient Modality Selection in Multimodal Learning JMLR 2024
Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithms NIPS 2024
DreamCatcher: A Wearer-aware Multi-modal Sleep Event Dataset Based on Earables in Non-restrictive Environments NIPS 2024
Images that Sound: Composing Images and Sounds on a Single Canvas NIPS 2024
DevBench: A multimodal developmental benchmark for language learning NIPS 2024
Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models NIPS 2024
A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era NIPS 2024
Neural Feature Learning in Function Space JMLR 2024
LoTLIP: Improving Language-Image Pre-training for Long Text Understanding NIPS 2024
Facilitating Multimodal Classification via Dynamically Learning Modality Gap NIPS 2024
MAN TruckScenes: A multimodal dataset for autonomous trucking in diverse conditions NIPS 2024