Multimodal Learning

WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NeurIPS 2024 Why do LLaVA Vision-Language Models Reply to Images in English? EMNLP 2024 Wit Hub@DravidianLangTech-2024:Multimodal Social Media Data Analysis in Dravidian Languages using Machine Learning Models EACL 2024 World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering EMNLP 2024 X4D-SceneFormer: Enhanced Scene Understanding on 4D Point Cloud Videos through Cross-Modal Knowledge Transfer AAAI 2024 XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning AAAI 2024 XMask3D: Cross-modal Mask Reasoning for Open Vocabulary 3D Semantic Segmentation NeurIPS 2024 X-MIC: Cross-Modal Instance Conditioning for Egocentric Action Generalization CVPR 2024 ***YesBut***: A High-Quality Annotated Multimodal Dataset for evaluating Satire Comprehension capability of Vision-Language Models EMNLP 2024 You Only Look at Screens: Multimodal Chain-of-Action Agents ACL 2024 Zero-shot Commonsense Reasoning over Machine Imagination EMNLP 2024 Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captions CVPR 2024 3D-TOGO: Towards Text-Guided Cross-Category 3D Object Generation AAAI 2023 A-Cap: Anticipation Captioning With Commonsense Knowledge CVPR 2023 Accommodating Audio Modality in CLIP for Multimodal Processing AAAI 2023 A Challenging Multimodal Video Summary: Simultaneously Extracting and Generating Keyframe-Caption Pairs from Video EMNLP 2023 A Composite Multi-Attention Framework for Intraoperative Hypotension Early Warning AAAI 2023 A Critical Analysis of Document Out-of-Distribution Detection EMNLP 2023 Adaptive Compositional Continual Meta-Learning ICML 2023 Aesthetically Relevant Image Captioning AAAI 2023 A Framework for Vision-Language Warm-up Tasks in Multimodal Dialogue Models EMNLP 2023 A General Framework for Multimodal Argument Persuasiveness Classification of Tweets EMNLP 2023 A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretraining ICML 2023 AircraftVerse: A Large-Scale Multimodal Dataset of Aerial Vehicle Designs NeurIPS 2023