Multimodal Learning

RegionCLIP: Region-Based Language-Image Pretraining CVPR 2022 Reinforced Cross-modal Alignment for Radiology Report Generation ACL 2022 Rethinking Multi-Modal Alignment in Multi-Choice VideoQA from Feature and Sample Perspectives EMNLP 2022 Rethinking the Two-Stage Framework for Grounded Situation Recognition AAAI 2022 Robust Cross-Modal Representation Learning With Progressive Self-Distillation CVPR 2022 Robustness Analysis of Video-Language Models Against Visual and Language Perturbations NeurIPS 2022 Robustness of Fusion-based Multimodal Classifiers to Cross-Modal Content Dilutions EMNLP 2022 Scaling Multimodal Pre-Training via Cross-Modality Gradient Harmonization NeurIPS 2022 ScanQA: 3D Question Answering for Spatial Scene Understanding CVPR 2022 Scene-Text Aware Image and Text Retrieval with Dual-Encoder ACL 2022 Seeing the advantage: visually grounding word embeddings to better capture human semantic knowledge ACL 2022 Self-Supervised Audio-and-Text Pre-training with Extremely Low-Resource Parallel Data AAAI 2022 Self-Supervised Object Detection From Audio-Visual Correspondence CVPR 2022 Semantically Distributed Robust Optimization for Vision-and-Language Inference ACL 2022 Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Information ACL 2022 Sentiment and Emotion-Aware Multi-Modal Complaint Identification AAAI 2022 Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors ACL 2022 Separate What You Describe: Language-Queried Audio Source Separation Interspeech 2022 SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning AAAI 2022 ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Model NeurIPS 2022 SHARE: a System for Hierarchical Assistive Recipe Editing EMNLP 2022 ShuttleNet: Position-Aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badminton AAAI 2022 SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-training for Spatial-Aware Visual Representations AAAI 2022 SimVLM: Simple Visual Language Model Pretraining with Weak Supervision ICLR 2022 Slot-VPS: Object-Centric Representation Learning for Video Panoptic Segmentation CVPR 2022