Multimodal Learning

SEnsor Alignment for Multivariate Time-Series Unsupervised Domain Adaptation AAAI 2023 Sentiment Knowledge Enhanced Self-supervised Learning for Multimodal Sentiment Analysis ACL 2023 Sequence-to-Sequence Multi-Modal Speech In-Painting Interspeech 2023 ShapeTalk: A Language Dataset and Framework for 3D Shape Edits and Deformations CVPR 2023 Show, Interpret and Tell: Entity-Aware Contextualised Image Captioning in Wikipedia AAAI 2023 Show, Write, and Retrieve: Entity-aware Article Generation and Retrieval EMNLP 2023 Simple and Efficient Heterogeneous Graph Neural Network AAAI 2023 Single-Stage Visual Query Localization in Egocentric Videos NeurIPS 2023 Skating-Mixer: Long-Term Sport Audio-Visual Modeling with MLPs AAAI 2023 SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images AAAI 2023 SmallCap: Lightweight Image Captioning Prompted With Retrieval Augmentation CVPR 2023 Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio NeurIPS 2023 Sound of Story: Multi-modal Storytelling with Audio EMNLP 2023 Sound to Visual Scene Generation by Audio-to-Visual Latent Alignment CVPR 2023 Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video ICCV 2023 SPRING: Situated Conversation Agent Pretrained with Multimodal Questions from Incremental Layout Graph AAAI 2023 Stereotypes and Smut: The (Mis)representation of Non-cisgender Identities by Text-to-Image Models ACL 2023 Stimulus Verification Is a Universal and Effective Sampler in Multi-Modal Human Trajectory Prediction CVPR 2023 Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages ACL 2023 Structure and Content-Guided Video Synthesis with Diffusion Models ICCV 2023 StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-Based Generator CVPR 2023 StyleTalk: One-Shot Talking Head Generation with Controllable Speaking Styles AAAI 2023 Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization ACL 2023 Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformation EMNLP 2023 SViTT: Temporal Learning of Sparse Video-Text Transformers CVPR 2023