Multimodal Learning

VideoLLM-online: Online Video Large Language Model for Streaming Video CVPR 2024 Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition ICML 2024 Video-P2P: Video Editing with Cross-attention Control CVPR 2024 VideoPoet: A Large Language Model for Zero-Shot Video Generation ICML 2024 VideoPrism: A Foundational Visual Encoder for Video Understanding ICML 2024 video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models ICML 2024 VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation EMNLP 2024 VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence CVPR 2024 VideoTetris: Towards Compositional Text-to-Video Generation NeurIPS 2024 VidLA: Video-Language Alignment at Scale CVPR 2024 ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models CVPR 2024 ViewFusion: Towards Multi-View Consistency via Interpolated Denoising CVPR 2024 VIEWS: Entity-Aware News Video Captioning EMNLP 2024 VIGC: Visual Instruction Generation and Correction AAAI 2024 VILA: On Pre-training for Visual Language Models CVPR 2024 ViLCo-Bench: VIdeo Language COntinual learning Benchmark NeurIPS 2024 ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models ICLR 2024 ViLT-CLIP: Video and Language Tuning CLIP with Multimodal Prompt Learning and Scenario-Guided Optimization AAAI 2024 VinT-6D: A Large-Scale Object-in-hand Dataset from Vision, Touch and Proprioception ICML 2024 ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts CVPR 2024 VIRL: Self-Supervised Visual Graph Inverse Reinforcement Learning CoRL 2024 Virtual Try-On: Real-Time Interactive Hybrid Network with High-Fidelity AAAI 2024 VisDiaHalBench: A Visual Dialogue Benchmark For Diagnosing Hallucination in Large Vision-Language Models ACL 2024 Vision-and-Language Navigation via Causal Learning CVPR 2024 Vision-by-Language for Training-Free Compositional Image Retrieval ICLR 2024