Vision-Language Models

VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detection AAAI 2024 VCoder: Versatile Vision Encoders for Multimodal Large Language Models CVPR 2024 Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models ACL 2024 Video-LLaVA: Learning United Visual Representation by Alignment Before Projection EMNLP 2024 VIGC: Visual Instruction Generation and Correction AAAI 2024 ViLa-MIL: Dual-scale Vision-Language Multiple Instance Learning for Whole Slide Image Classification CVPR 2024 ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts CVPR 2024 Vision-Language Models are Strong Noisy Label Detectors NeurIPS 2024 VISTA-LLAMA: Reducing Hallucination in Video Language Models via Equal Distance to Visual Tokens CVPR 2024 Visual Data-Type Understanding does not emerge from scaling Vision-Language Models ICLR 2024 ViTamin: Designing Scalable Vision Models in the Vision-Language Era CVPR 2024 Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing NeurIPS 2024 VLCounter: Text-Aware Visual Representation for Zero-Shot Object Counting AAAI 2024 VLEU: a Method for Automatic Evaluation for Generalizability of Text-to-Image Models EMNLP 2024 VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance NeurIPS 2024 VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought NeurIPS 2024 VPL: Visual Proxy Learning Framework for Zero-Shot Medical Image Diagnosis EMNLP 2024 VTimeLLM: Empower LLM to Grasp Video Moments CVPR 2024 WATT: Weight Average Test Time Adaptation of CLIP NeurIPS 2024 What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models CVPR 2024 What matters when building vision-language models? NeurIPS 2024 What to Say and When to Say it: Live Fitness Coaching as a Testbed for Situated Interaction NeurIPS 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NeurIPS 2024 Why are Visually-Grounded Language Models Bad at Image Classification? NeurIPS 2024 Why do LLaVA Vision-Language Models Reply to Images in English? EMNLP 2024