conftrace_

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark NIPS 2024

Can Large Multimodal Models Uncover Deep Semantics Behind Images? ACL 2024

UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Training NIPS 2024

RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method CVPR 2024

Large Language Models can Share Images, Too! ACL 2024

VideoCon: Robust Video-Language Alignment via Contrast Captions CVPR 2024

Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detection CVPR 2024

Making Visual Sense of Oracle Bones for You and Me CVPR 2024

JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups CVPR 2024

MoExtend: Tuning New Experts for Modality and Task Extension ACL 2024

You Only Look at Screens: Multimodal Chain-of-Action Agents ACL 2024

DIEM: Decomposition-Integration Enhancing Multimodal Insights CVPR 2024

SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs ACL 2024

DiaLoc: An Iterative Approach to Embodied Dialog Localization CVPR 2024

MMAD:Multi-modal Movie Audio Description COLING 2024

Looking Similar Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning CVPR 2024

Towards Answering Health-related Questions from Medical Videos: Datasets and Approaches COLING 2024

Step Differences in Instructional Video CVPR 2024

OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios ACL 2024

AFBench: A Large-scale Benchmark for Airfoil Design NIPS 2024

Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality ACL 2024

MuseChat: A Conversational Music Recommendation System for Videos CVPR 2024

Fusion from a Distributional Perspective: A Unified Symbiotic Diffusion Framework for Any Multisource Remote Sensing Data Classification IJCAI 2024

Zero-Shot Sketch Based Image Retrieval via Modality Capacity Guidance IJCAI 2024

MEVTR: A Multilingual Model Enhanced with Visual Text Representations COLING 2024