multimodal learning

Sequential Compositional Generalization in Multimodal Models NAACL 2024 Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling EMNLP 2024 ShapeLLM: Universal 3D Object Understanding for Embodied Interaction ECCV 2024 ShARc: Shape and Appearance Recognition for Person Identification In-the-Wild WACV 2024 ShareGPT4Video: Improving Video Understanding and Generation with Better Captions NeurIPS 2024 Show and Guide: Instructional-Plan Grounded Vision and Language Model EMNLP 2024 Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation ICLR 2024 SignCLIP: Connecting Text and Sign Language by Contrastive Learning EMNLP 2024 Sim2Real-Fire: A Multi-modal Simulation Dataset for Forecast and Backtracking of Real-world Forest Fire NeurIPS 2024 SimDistill: Simulated Multi-Modal Distillation for BEV 3D Object Detection AAAI 2024 Simple Image-Level Classification Improves Open-Vocabulary Object Detection AAAI 2024 Single Frame Semantic Segmentation Using Multi-Modal Spherical Images WACV 2024 Single-Model and Any-Modality for Video Object Tracking CVPR 2024 SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery CVPR 2024 Slice-100K: A Multimodal Dataset for Extrusion-based 3D Printing NeurIPS 2024 SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition ACL 2024 Slot-VLM: Object-Event Slots for Video-Language Modeling NeurIPS 2024 SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM NeurIPS 2024 SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models NAACL 2024 SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM EMNLP 2024 SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-training ICLR 2024 Soft Knowledge Prompt: Help External Knowledge Become a Better Teacher to Instruct LLM in Knowledge-based VQA ACL 2024 Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning COLING 2024 Solar Power Generation Forecasting via Multimodal Feature Fusion (Student Abstract) AAAI 2024 SoMeLVLM: A Large Vision Language Model for Social Media Processing ACL 2024