Multimodal Learning

Shifting More Attention to Visual Backbone: Query-Modulated Refinement Networks for End-to-End Visual Grounding CVPR 2022 TaiSu: A 166M Large-scale High-Quality Dataset for Chinese Vision-Language Pre-training NeurIPS 2022 TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition NeurIPS 2022 Target-Aware Dual Adversarial Learning and a Multi-Scenario Multi-Modality Benchmark To Fuse Infrared and Visible for Object Detection CVPR 2022 TubeDETR: Spatio-Temporal Video Grounding With Transformers CVPR 2022 Understanding Attention for Vision-and-Language Tasks COLING 2022 Unsupervised Vision-and-Language Pre-Training via Retrieval-Based Multi-Granular Alignment CVPR 2022 UTC: A Unified Transformer With Inter-Task Contrastive Learning for Visual Dialog CVPR 2022 Vector Quantized Diffusion Model for Text-to-Image Synthesis CVPR 2022 VGNMN: Video-grounded Neural Module Networks for Video-Grounded Dialogue Systems NAACL 2022 Video-Text Representation Learning via Differentiable Weak Temporal Alignment CVPR 2022 ViLMedic: a framework for research at the intersection of vision and language in medical AI ACL 2022 Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline CVPR 2022 VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attention CVPR 2022 Visual Acoustic Matching CVPR 2022 Visual Commonsense in Pretrained Unimodal and Multimodal Models NAACL 2022 Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows COLING 2022 Weakly-Supervised Generation and Grounding of Visual Descriptions With Conditional Generative Models CVPR 2022 Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality EMNLP 2022 Adaptive Cross-Modal Prototypes for Cross-Domain Visual-Language Retrieval CVPR 2021 Adversarial Turing Patterns from Cellular Automata AAAI 2021 A Novel Visual Interpretability for Deep Neural Networks by Optimizing Activation Maps with Perturbation AAAI 2021 ArtEmis: Affective Language for Visual Art CVPR 2021 Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking EMNLP 2021 Binaural Audio-Visual Localization AAAI 2021