multimodal learning

Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models NeurIPS 2024 Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant EMNLP 2024 ViT-Lens: Towards Omni-modal Representations CVPR 2024 Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing NeurIPS 2024 VIVA: A Benchmark for Vision-Grounded Decision-Making with Human Values EMNLP 2024 VIXEN: Visual Text Comparison Network for Image Difference Captioning AAAI 2024 VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark NeurIPS 2024 VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought NeurIPS 2024 Vlogger: Make Your Dream A Vlog CVPR 2024 Voila-A: Aligning Vision-Language Models with User's Gaze Attention NeurIPS 2024 VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models AAAI 2024 Vript: A Video Is Worth Thousands of Words NeurIPS 2024 VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learning CVPR 2024 VTimeLLM: Empower LLM to Grasp Video Moments CVPR 2024 VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media Reasoning CVPR 2024 Vulnerabilities of Large Language Models to Adversarial Attacks ACL 2024 WangLab at MEDIQA-M3G 2024: Multimodal Medical Answer Generation using Large Language Models NAACL 2024 WavLLM: Towards Robust and Adaptive Speech Large Language Model EMNLP 2024 Weakly-Supervised Audio-Visual Video Parsing with Prototype-based Pseudo-Labeling CVPR 2024 Weakly Supervised Multimodal Affordance Grounding for Egocentric Images AAAI 2024 Web-Scale Visual Entity Recognition: An LLM-Driven Data Approach NeurIPS 2024 WebVLN: Vision-and-Language Navigation on Websites AAAI 2024 Well, Now We Know! Unveiling Sarcasm: Initiating and Exploring Multimodal Conversations with Reasoning AAAI 2024 What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models CVPR 2024 What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models EMNLP 2024