multimodal learning

What Matters in Training a GPT4-Style Language Model with Multimodal Inputs? NAACL 2024 What matters when building vision-language models? NeurIPS 2024 What When and Where? Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions CVPR 2024 When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detection EMNLP 2024 Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing EMNLP 2024 Which Modality should I use - Text, Motif, or Image? : Understanding Graphs with Large Language Models NAACL 2024 WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 Why do LLaVA Vision-Language Models Reply to Images in English? EMNLP 2024 WikiScenes with Descriptions: Aligning Paragraphs and Sentences with Images in Wikipedia Articles NAACL 2024 WildPPG: A Real-World PPG Dataset of Long Continuous Recordings NeurIPS 2024 WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences NeurIPS 2024 With Ears to See and Eyes to Hear: Sound Symbolism Experiments with Multimodal Large Language Models EMNLP 2024 Wit Hub@DravidianLangTech-2024:Multimodal Social Media Data Analysis in Dravidian Languages using Machine Learning Models EACL 2024 WonderJourney: Going from Anywhere to Everywhere CVPR 2024 Word-Aware Modality Stimulation for Multimodal Fusion COLING 2024 WW-CSL: A New Dataset for Word-Based Wearable Chinese Sign Language Detection COLING 2024 XAI for Better Exploitation of Text in Medical Decision Support ACL 2024 XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning AAAI 2024 ***YesBut***: A High-Quality Annotated Multimodal Dataset for evaluating Satire Comprehension capability of Vision-Language Models EMNLP 2024 You Only Look at Screens: Multimodal Chain-of-Action Agents ACL 2024 Your Prompt Is My Command: On Assessing the Human-Centred Generality of Multimodal Models (Abstract Reprint) AAAI 2024 YTCommentQA: Video Question Answerability in Instructional Videos AAAI 2024 YYama@Multimodal Hate Speech Event Detection 2024: Simpler Prompts, Better Results - Enhancing Zero-shot Detection with a Large Multimodal Model EACL 2024 Zero-shot Commonsense Reasoning over Machine Imagination EMNLP 2024 Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancement ICML 2024