Multimodal Learning

Towards Unified, Explainable, and Robust Multisensory Perception AAAI 2023 Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data AISTATS 2023 Unified Coarse-to-Fine Alignment for Video-Text Retrieval ICCV 2023 UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding ACL 2023 Unifying Text, Tables, and Images for Multimodal Question Answering EMNLP 2023 Unifying Vision-Language Representation Space with Single-Tower Transformer AAAI 2023 UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023 UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model EMNLP 2023 Video-Helpful Multimodal Machine Translation EMNLP 2023 Video-Text Pre-training with Learned Regions for Retrieval AAAI 2023 VindLU: A Recipe for Effective Video-and-Language Pretraining CVPR 2023 Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information ACL 2023 Vision Transformers Are Parameter-Efficient Audio-Visual Learners CVPR 2023 Visual Elements Mining as Prompts for Instruction Learning for Target-Oriented Multimodal Sentiment Classification EMNLP 2023 Visually Grounded Commonsense Knowledge Acquisition AAAI 2023 Visually Grounded Continual Language Learning with Selective Specialization EMNLP 2023 Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation EMNLP 2023 Visual Storytelling with Question-Answer Plans EMNLP 2023 VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloud CVPR 2023 Vocabulary-free Image Classification NeurIPS 2023 What Happened 3 Seconds Ago? Inferring the Past With Thermal Imaging CVPR 2023 When are Lemons Purple? The Concept Association Bias of Vision-Language Models EMNLP 2023 Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding ACL 2023 XtremeCLIP: Extremely Parameter-efficient Tuning for Low-resource Vision Language Understanding ACL 2023 Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style CVPR 2023