Multimodal Learning

Expedited Training of Visual Conditioned Language Generation via Redundancy Reduction ACL 2024 Extended Multimodal Hate Speech Event Detection During Russia-Ukraine Crisis - Shared Task at CASE 2024 EACL 2024 Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning NeurIPS 2024 Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs CVPR 2024 Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAM CVPR 2024 Federated Learning from Vision-Language Foundation Models: Theoretical Analysis and Method NeurIPS 2024 FELGA: Unsupervised Fragment Embedding for Fine-Grained Cross-Modal Association WACV 2024 Few-Shot Adversarial Prompt Learning on Vision-Language Models NeurIPS 2024 FineCLIP: Self-distilled Region-based CLIP for Better Fine-grained Understanding NeurIPS 2024 Fine-Grained Alignment for Cross-Modal Recipe Retrieval WACV 2024 Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models EMNLP 2024 From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis EMNLP 2024 Fusion-Vital: Video-RF Fusion Transformer for Advanced Remote Physiological Measurement AAAI 2024 G^2SAM: Graph-Based Global Semantic Awareness Method for Multimodal Sarcasm Detection AAAI 2024 GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning CVPR 2024 GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformer ICML 2024 Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyond ACL 2024 GLaMM: Pixel Grounding Large Multimodal Model CVPR 2024 Grounding Everything: Emerging Localization Properties in Vision-Language Transformers CVPR 2024 Grounding Partially-Defined Events in Multimodal Data EMNLP 2024 GrounDiT: Grounding Diffusion Transformers via Noisy Patch Transplantation NeurIPS 2024 HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models CVPR 2024 HALSIE: Hybrid Approach to Learning Segmentation by Simultaneously Exploiting Image and Event Modalities WACV 2024 HEAL-SWIN: A Vision Transformer On The Sphere CVPR 2024 HENASY: Learning to Assemble Scene-Entities for Interpretable Egocentric Video-Language Model NeurIPS 2024