Multimodal Learning

SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information EMNLP 2024 SuteAlbastre at SemEval-2024 Task 4: Predicting Propaganda Techniques in Multilingual Memes using Joint Text and Vision Transformers SemEval 2024 SVGDreamer: Text Guided SVG Generation with Diffusion Model CVPR 2024 Switching Tongues, Sharing Hearts: Identifying the Relationship between Empathy and Code-switching in Speech Interspeech 2024 SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment ICML 2024 Symbol as Points: Panoptic Symbol Spotting via Point-based Representation ICLR 2024 Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline ACL 2024 SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining CVPR 2024 SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis CVPR 2024 Synonym relations affect object detection learned on vision-language data NAACL 2024 Synthesize Diagnose and Optimize: Towards Fine-Grained Vision-Language Understanding CVPR 2024 Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA CVPR 2024 Synthetic Multimodal Question Generation EMNLP 2024 T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognition NeurIPS 2024 T5-Medical at SemEval-2024 Task 2: Using T5 Medical Embedding for Natural Language Inference on Clinical Trial Data SemEval 2024 Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs ACL 2024 TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy NeurIPS 2024 Tabular Insights, Visual Impacts: Transferring Expertise from Tables to Images ICML 2024 Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering WACV 2024 Tackling Missing Modalities in Audio-Visual Representation Learning Using Masked Autoencoders Interspeech 2024 Tackling Uncertain Correspondences for Multi-Modal Entity Alignment NeurIPS 2024 Tackling Vision Language Tasks through Learning Inner Monologues AAAI 2024 Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generation NeurIPS 2024 Tag2Text: Guiding Vision-Language Model via Image Tagging ICLR 2024 TagCLIP: A Local-to-Global Framework to Enhance Open-Vocabulary Multi-Label Classification of CLIP without Training AAAI 2024