Papers
Large Language Models as Automated Aligners for benchmarking Vision-Language Models
Yuanfeng Ji, Chongjian GE, Weikai Kong et al.
Language Models as Black-Box Optimizers for Vision-Language Models
Shihong Liu, Samuel Yu, Zhiqiu Lin et al.
Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress?
Daniel P Jeong, Saurabh Garg, Zachary Chase Lipton et al.
Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Models
Tobias Groot, Matias Valdenegro - Toro
Towards Better Vision-Inspired Vision-Language Models
Yun-Hao Cao, Kaixiang Ji, Ziyuan Huang et al.
Magnet: We Never Know How Text-to-Image Diffusion Models Work, Until We Learn How Vision-Language Models Function
Chenyi Zhuang, Ying Hu, Pan Gao
HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models
Tianrui Guan, Fuxiao Liu, Xiyang Wu et al.
Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning
Juan Rocamonde, Victoriano Montesinos, Elvis Nava et al.
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
Deyao Zhu, Jun Chen, Xiaoqian Shen et al.
ViTamin: Designing Scalable Vision Models in the Vision-Language Era
Jieneng Chen, Qihang Yu, Xiaohui Shen et al.
Vary: Scaling up the Vision Vocabulary for Large Vision-Language Models
Haoran Wei, Lingyu Kong, Jinyue Chen et al.
DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback
Yangyi Chen, Karan Sikka, Michael Cogswell et al.
Voila-A: Aligning Vision-Language Models with User's Gaze Attention
Kun Yan, Zeyu Wang, Lei Ji et al.
Few-Shot Adversarial Prompt Learning on Vision-Language Models
Yiwei Zhou, Xiaobo Xia, Zhiwei Lin et al.
Towards Calibrated Robust Fine-Tuning of Vision-Language Models
Changdae Oh, Hyesu Lim, Mijoo Kim et al.
NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samples
Baiqi Li, Zhiqiu Lin, Wenxuan Peng et al.
Revisiting Few-Shot Object Detection with Vision-Language Models
Anish Madan, Neehar Peri, Shu Kong et al.
A Unified Debiasing Approach for Vision-Language Models across Modalities and Tasks
Hoin Jung, Taeuk Jang, Xiaoqian Wang
AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation
Yuhan Zhu, Yuyang Ji, Zhiyu Zhao et al.
Are We on the Right Way for Evaluating Large Vision-Language Models?
Lin Chen, Jinsong Li, Xiaoyi Dong et al.
Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models
Ce Zhang, Simon Stepputtis, Katia Sycara et al.
AdaNeg: Adaptive Negative Proxy Guided OOD Detection with Vision-Language Models
Yabin Zhang, Lei Zhang
WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
Yujie Lu, Dongfu Jiang, Wenhu Chen et al.
Matryoshka Query Transformer for Large Vision-Language Models
Wenbo Hu, Zi-Yi Dou, Liunian Harold Li et al.
Advancing Cross-domain Discriminability in Continual Learning of Vision-Language Models
Yicheng Xu, Yuxin Chen, Jiahao Nie et al.