Multimodal Learning

Vript: A Video Is Worth Thousands of Words NeurIPS 2024 VRP-SAM: SAM with Visual Reference Prompt CVPR 2024 VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learning CVPR 2024 VTimeLLM: Empower LLM to Grasp Video Moments CVPR 2024 WANDR: Intention-guided Human Motion Generation CVPR 2024 WangLab at MEDIQA-M3G 2024: Multimodal Medical Answer Generation using Large Language Models NAACL 2024 Wav2SQL: Direct Generalizable Speech-To-SQL Parsing ACL 2024 WaveMo: Learning Wavefront Modulations to See Through Scattering CVPR 2024 WavLLM: Towards Robust and Adaptive Speech Large Language Model EMNLP 2024 Weakly-supervised Audio Separation via Bi-modal Semantic Similarity ICLR 2024 Weakly-Supervised Audio-Visual Video Parsing with Prototype-based Pseudo-Labeling CVPR 2024 Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation CVPR 2024 Weakly Supervised Multimodal Affordance Grounding for Egocentric Images AAAI 2024 Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs NeurIPS 2024 WebLINX: Real-World Website Navigation with Multi-Turn Dialogue ICML 2024 Web-Scale Visual Entity Recognition: An LLM-Driven Data Approach NeurIPS 2024 WebVLN: Vision-and-Language Navigation on Websites AAAI 2024 WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models ACL 2024 Well, Now We Know! Unveiling Sarcasm: Initiating and Exploring Multimodal Conversations with Reasoning AAAI 2024 Well-Written Knowledge Graphs: Most Effective RDF Syntaxes for Triple Linearization in End-to-End Extraction of Relations from Texts (Student Abstract) AAAI 2024 What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases NAACL 2024 What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language models ACL 2024 What Do You See in Vehicle? Comprehensive Vision Solution for In-Vehicle Gaze Estimation CVPR 2024 What explains the success of cross-modal fine-tuning with ORCA? NAACL 2024 What Factors Affect Multi-Modal In-Context Learning? An In-Depth Exploration NeurIPS 2024