Multimodal Learning

Exploring the Capability of Multimodal LLMs with Yonkoma Manga: The YManga Dataset and Its Challenging Tasks EMNLP 2024 Exploring the Potential of Dense Information in Multimodal Alignment ACL 2024 Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detection CVPR 2024 Exploring the Potential of Multimodal LLM with Knowledge-Intensive Multimodal ASR EMNLP 2024 Exploring the Robustness of Text-to-Speech Synthesis Based on Diffusion Probabilistic Models to Heavily Noisy Transcriptions Interspeech 2024 Exploring the Suitability of Transformer Models to Analyse Mental Health Peer Support Forum Data for a Realist Evaluation COLING 2024 Exploring the Transferability of Visual Prompting for Multimodal Large Language Models CVPR 2024 Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models MIDL 2024 Exploring Union and Intersection of Visual Regions for Generating Questions, Answers, and Distractors EMNLP 2024 Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patches CVPR 2024 Extended Multimodal Hate Speech Event Detection During Russia-Ukraine Crisis - Shared Task at CASE 2024 EACL 2024 Extending AZee with Non-manual Gesture Rules for French Sign Language COLING 2024 Extending Multi-modal Contrastive Representations NeurIPS 2024 EXTRACT: Efficient Policy Learning by Extracting Transferable Robot Skills from Offline Data CoRL 2024 Extracting Training Data From Document-Based VQA Models ICML 2024 Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning NeurIPS 2024 Eyes Don’t Lie: Subjective Hate Annotation and Detection with Gaze EMNLP 2024 Eye-Tracking Features Masking Transformer Attention in Question-Answering Tasks COLING 2024 EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detection NeurIPS 2024 FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio CVPR 2024 Faces that Speak: Jointly Synthesising Talking Face and Speech from Text CVPR 2024 Facilitating Multimodal Classification via Dynamically Learning Modality Gap NeurIPS 2024 Facing the Elephant in the Room: Visual Prompt Tuning or Full finetuning? ICLR 2024 Factor-Conditioned Speaking-Style Captioning Interspeech 2024 Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation COLING 2024