Multimodal Learning

Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task AAAI 2023 SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions NeurIPS 2023 Synthesizing Photorealistic Virtual Humans Through Cross-Modal Disentanglement CVPR 2023 TableVLM: Multi-modal Pre-training for Table Structure Recognition ACL 2023 Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation ACL 2023 Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection ACL 2023 Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval AAAI 2023 Target-Free Text-Guided Image Manipulation AAAI 2023 Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation EMNLP 2023 TAVT: Towards Transferable Audio-Visual Text Generation ACL 2023 Tell Me What Happened: Unifying Text-Guided Video Completion via Multimodal Masked Video Generation CVPR 2023 Temporally Aligning Long Audio Interviews with Questions: A Case Study in Multimodal Data Integration IJCAI 2023 TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities ACL 2023 TeSTNeRF: Text-Driven 3D Style Transfer via Cross-Modal Learning IJCAI 2023 Test-Time Distribution Normalization for Contrastively Learned Visual-language Models NeurIPS 2023 Text encoders bottleneck compositionality in contrastive vision-language models EMNLP 2023 Text-guided 3D Human Generation from 2D Collections EMNLP 2023 Texts as Images in Prompt Tuning for Multi-Label Image Recognition CVPR 2023 Text-Visual Prompting for Efficient 2D Temporal Video Grounding CVPR 2023 Text With Knowledge Graph Augmented Transformer for Video Captioning CVPR 2023 The D-WISE Tool Suite: Multi-Modal Machine-Learning-Powered Tools Supporting and Enhancing Digital Discourse Analysis ACL 2023 The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation EMNLP 2023 The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion ICCV 2023 Three Stream Based Multi-level Event Contrastive Learning for Text-Video Event Extraction EMNLP 2023 Token Mixing: Parameter-Efficient Transfer Learning from Image-Language to Video-Language AAAI 2023