Multimodal Learning

DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction CVPR 2024 DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation CVPR 2024 Diffusion-based Reinforcement Learning via Q-weighted Variational Policy Optimization NeurIPS 2024 DiPEx: Dispersing Prompt Expansion for Class-Agnostic Object Detection NeurIPS 2024 Direction-Aware Video Demoiréing with Temporal-Guided Bilateral Learning AAAI 2024 Direct Preference Optimization for Suppressing Hallucinated Prior Exams in Radiology Report Generation MLHC 2024 DisCo: Disentangled Control for Realistic Human Dance Generation CVPR 2024 Discriminative Probing and Tuning for Text-to-Image Generation CVPR 2024 DIUSum: Dynamic Image Utilization for Multimodal Summarization AAAI 2024 Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation AAAI 2024 Diversify, Rationalize, and Combine: Ensembling Multiple QA Strategies for Zero-shot Knowledge-based VQA EMNLP 2024 Divide and Conquer Radiology Report Generation via Observation Level Fine-grained Pretraining and Prompt Tuning EMNLP 2024 DMR: Decomposed Multi-Modality Representations for Frames and Events Fusion in Visual Reinforcement Learning CVPR 2024 DocEdit-v2: Document Structure Editing Via Multimodal LLM Grounding EMNLP 2024 DocFormerv2: Local Features for Document Understanding AAAI 2024 DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models EMNLP 2024 Domain Prompt Learning with Quaternion Networks CVPR 2024 Do Text-to-Vis Benchmarks Test Real Use of Visualisations? EMNLP 2024 Do Vision and Language Encoders Represent the World Similarly? CVPR 2024 DreamCatcher: A Wearer-aware Multi-modal Sleep Event Dataset Based on Earables in Non-restrictive Environments NeurIPS 2024 DreamComposer: Controllable 3D Object Generation via Multi-View Conditions CVPR 2024 DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback CVPR 2024 Drones Help Drones: A Collaborative Framework for Multi-Drone Object Trajectory Prediction and Beyond NeurIPS 2024 Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models CVPR 2024 Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection EMNLP 2024