conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition CVPR 2024
What matters when building vision-language models? NIPS 2024
Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs NIPS 2024
Efficient Modality Selection in Multimodal Learning JMLR 2024
Enhancing Multimodal Cooperation via Sample-level Modality Valuation CVPR 2024
Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithms NIPS 2024
DreamCatcher: A Wearer-aware Multi-modal Sleep Event Dataset Based on Earables in Non-restrictive Environments NIPS 2024
Images that Sound: Composing Images and Sounds on a Single Canvas NIPS 2024
DevBench: A multimodal developmental benchmark for language learning NIPS 2024
Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction CVPR 2024
Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models NIPS 2024
A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era NIPS 2024
Neural Feature Learning in Function Space JMLR 2024
LoTLIP: Improving Language-Image Pre-training for Long Text Understanding NIPS 2024
Facilitating Multimodal Classification via Dynamically Learning Modality Gap NIPS 2024
Modality-Collaborative Test-Time Adaptation for Action Recognition CVPR 2024
Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities CVPR 2024
MAN TruckScenes: A multimodal dataset for autonomous trucking in diverse conditions NIPS 2024
Unsupervised Homography Estimation on Multimodal Image Pair via Alternating Optimization NIPS 2024
Aligning Audio-Visual Joint Representations with an Agentic Workflow NIPS 2024
The Multimodal Universe: Enabling Large-Scale Machine Learning with 100 TB of Astronomical Scientific Data NIPS 2024
Detecting and Preventing Hallucinations in Large Vision Language Models AAAI 2024
CoIN: A Benchmark of Continual Instruction Tuning for Multimodel Large Language Models NIPS 2024
Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities NIPS 2024
Learning from Multiple Annotator Biased Labels in Multimodal Conversation INTERSPEECH 2024