Multimodal Learning

VGA: Vision GUI Assistant - Minimizing Hallucinations through Image-Centric Fine-Tuning EMNLP 2024 VGBench: Evaluating Large Language Models on Vector Graphics Understanding and Generation EMNLP 2024 V-GlórIA - Customizing Large Vision and Language Models to European Portuguese EMNLP 2024 V?: Guided Visual Search as a Core Mechanism in Multimodal LLMs CVPR 2024 VHASR: A Multimodal Speech Recognition System With Vision Hotwords EMNLP 2024 VHELM: A Holistic Evaluation of Vision Language Models NeurIPS 2024 ViCor: Bridging Visual Understanding and Commonsense Reasoning with Large Language Models ACL 2024 VicTR: Video-conditioned Text Representations for Activity Recognition CVPR 2024 VideoBooth: Diffusion-based Video Generation with Image Prompts CVPR 2024 Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models ACL 2024 VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models EMNLP 2024 VideoCon: Robust Video-Language Alignment via Contrast Captions CVPR 2024 Video-Context Aligned Transformer for Video Question Answering AAAI 2024 VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Tool ACL 2024 Video Discourse Parsing and Its Application to Multimodal Summarization: A Dataset and Baseline Approaches EMNLP 2024 Video Event Extraction with Multi-View Interaction Knowledge Distillation AAAI 2024 Video Frame Interpolation via Direct Synthesis with the Event-based Reference CVPR 2024 VideoGrounding-DINO: Towards Open-Vocabulary Spatio-Temporal Video Grounding CVPR 2024 VideoGUI: A Benchmark for GUI Automation from Instructional Videos NeurIPS 2024 VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMs EMNLP 2024 Video Language Planning ICLR 2024 Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives ACL 2024 Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization ICML 2024 Video-LLaVA: Learning United Visual Representation by Alignment Before Projection EMNLP 2024 VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computation NeurIPS 2024