Vision-Language Models

Revisiting Temporal Modeling for CLIP-Based Image-to-Video Knowledge Transferring CVPR 2023 ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense EMNLP 2023 Scaling Language-Image Pre-Training via Masking CVPR 2023 Side Adapter Network for Open-Vocabulary Semantic Segmentation CVPR 2023 STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training AAAI 2023 SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality NeurIPS 2023 Table and Image Generation for Investigating Knowledge of Entities in Pre-trained Vision and Language Models ACL 2023 Task Residual for Tuning Vision-Language Models CVPR 2023 Test of Time: Instilling Video-Language Models With a Sense of Time CVPR 2023 Test-Time Distribution Normalization for Contrastively Learned Visual-language Models NeurIPS 2023 Text Promptable Surgical Instrument Segmentation with Vision-Language Models NeurIPS 2023 Three Towers: Flexible Contrastive Learning with Pretrained Image Models NeurIPS 2023 Top-Down Visual Attention From Analysis by Synthesis CVPR 2023 Turning a CLIP Model Into a Scene Text Detector CVPR 2023 Unifying Vision-Language Representation Space with Single-Tower Transformer AAAI 2023 Unifying Vision, Text, and Layout for Universal Document Processing CVPR 2023 Universal Instance Perception As Object Discovery and Retrieval CVPR 2023 VindLU: A Recipe for Effective Video-and-Language Pretraining CVPR 2023 Violet: A Vision-Language Model for Arabic Image Captioning with Gemini Decoder EMNLP 2023 VIPHY: Probing “Visible” Physical Commonsense Knowledge EMNLP 2023 VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models NeurIPS 2023 Visual Instruction Tuning NeurIPS 2023 VLIS: Unimodal Language Models Guide Multimodal Language Generation EMNLP 2023 Align and Prompt: Video-and-Language Pre-Training With Entity Prompts CVPR 2022 An Anchor-based Relative Position Embedding Method for Cross-Modal Tasks EMNLP 2022