Multimodal Learning

Self-Guided Masked Autoencoder NeurIPS 2024 Semantic Token Reweighting for Interpretable and Controllable Text Embeddings in CLIP EMNLP 2024 SEMANTIFY: Unveiling Memes with Robust Interpretability beyond Input Attribution IJCAI 2024 Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language CVPR 2024 ShareGPT4Video: Improving Video Understanding and Generation with Better Captions NeurIPS 2024 SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction CVPR 2024 Single Frame Semantic Segmentation Using Multi-Modal Spherical Images WACV 2024 Single Image Reflection Separation via Dual-Stream Interactive Transformers NeurIPS 2024 Single-Model and Any-Modality for Video Object Tracking CVPR 2024 Sketch-Based Video Object Localization WACV 2024 SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery CVPR 2024 Slicing Vision Transformer for Flexible Inference NeurIPS 2024 SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM NeurIPS 2024 SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples CVPR 2024 SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos CVPR 2024 SRTube: Video-Language Pre-Training with Action-Centric Video Tube Features and Semantic Role Labeling CVPR 2024 SSA-Seg: Semantic and Spatial Adaptive Pixel-level Classifier for Semantic Segmentation NeurIPS 2024 StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On CVPR 2024 Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-Modal Structured Representations AAAI 2024 Summarize the Past to Predict the Future: Natural Language Descriptions of Context Boost Multimodal Object Interaction Anticipation CVPR 2024 Suppress Content Shift: Better Diffusion Features via Off-the-Shelf Generation Techniques NeurIPS 2024 SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information EMNLP 2024 Tactile-Augmented Radiance Fields CVPR 2024 Tag-grounded Visual Instruction Tuning with Retrieval Augmentation EMNLP 2024 TCP:Textual-based Class-aware Prompt tuning for Visual-Language Model CVPR 2024