Multimodal Learning

ViP3D: End-to-End Visual Trajectory Prediction via 3D Agent Queries CVPR 2023 VIP5: Towards Multimodal Foundation Models for Recommendation EMNLP 2023 Vision Language Pre-training by Contrastive Learning with Cross-Modal Similarity Regulation ACL 2023 VISTA: Visual-Textual Knowledge Graph Representation Learning EMNLP 2023 VisText: A Benchmark for Semantically Rich Chart Captioning ACL 2023 Visual Coherence Loss for Coherent and Visually Grounded Story Generation ACL 2023 Visually-augmented pretrained language models for NLP tasks without images ACL 2023 Visually-Enhanced Phrase Understanding ACL 2023 Visually Grounded Commonsense Knowledge Acquisition AAAI 2023 Visually Grounded Continual Language Learning with Selective Specialization EMNLP 2023 Visual-Tactile Sensing for In-Hand Object Reconstruction CVPR 2023 VKIE: The Application of Key Information Extraction on Video Text EMNLP 2023 VLIS: Unimodal Language Models Guide Multimodal Language Generation EMNLP 2023 VLPD: Context-Aware Pedestrian Detection via Vision-Language Semantic Self-Supervision CVPR 2023 VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloud CVPR 2023 VQACL: A Novel Visual Question Answering Continual Learning Setting CVPR 2023 VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions ACL 2023 Watch or Listen: Robust Audio-Visual Speech Recognition With Visual Corruption Modeling and Reliability Scoring CVPR 2023 Weakly-Supervised Learning of Visual Relations in Multimodal Pretraining EMNLP 2023 Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning ACL 2023 Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Erasing Network CVPR 2023 What Can Human Sketches Do for Object Detection? CVPR 2023 What Do You MEME? Generating Explanations for Visual Semantic Role Labelling in Memes AAAI 2023 What to Fuse and How to Fuse: Exploring Emotion and Personality Fusion Strategies for Explainable Mental Disorder Detection ACL 2023 Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding ACL 2023