Papers
NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks
Fawaz Sammani, Tanmoy Mukherjee, Nikos Deligiannis
Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting
Chuhui Xue, Wenqing Zhang, Yu Hao et al.
Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs With Language Structures via Dependency Relationships
Chao Lou, Wenjuan Han, Yuhuan Lin et al.
Towards General Purpose Vision Systems: An End-to-End Task-Agnostic Vision-Language Architecture
Tanmay Gupta, Amita Kamath, Aniruddha Kembhavi et al.
Divert More Attention to Vision-Language Tracking
Mingzhe Guo, Zhipeng Zhang, Heng Fan et al.
Fine-Grained Semantically Aligned Vision-Language Pre-Training
Juncheng Li, XIN HE, Longhui Wei et al.
TVLT: Textless Vision-Language Transformer
Zineng Tang, Jaemin Cho, Yixin Nie et al.
Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models
Manli Shu, Weili Nie, De-An Huang et al.
TaiSu: A 166M Large-scale High-Quality Dataset for Chinese Vision-Language Pre-training
Yulong Liu, Guibo Zhu, Bin Zhu et al.
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
Hangbo Bao, Wenhui Wang, Li Dong et al.
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan et al.
Delving into Out-of-Distribution Detection with Vision-Language Representations
Yifei Ming, Ziyang Cai, Jiuxiang Gu et al.
PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining
Yuting Gao, Jinfeng Liu, Zihan Xu et al.
GLIPv2: Unifying Localization and Vision-Language Understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu et al.
Contrastive Instruction-Trajectory Learning for Vision-Language Navigation
Xiwen Liang, Fengda Zhu, Yi Zhu et al.
Are Vision-Language Transformers Learning Multimodal Representations? A Probing Perspective
Emmanuelle Salin, Badreddine Farah, Stéphane Ayache et al.
VLStereoSet: A Study of Stereotypical Bias in Pre-trained Vision-Language Models
Kankan Zhou, Eason Lai, Jing Jiang
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning
Hugo Berg, Siobhan Hall, Yash Bhalgat et al.
Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis
Yan Ling, Jianfei Yu, Rui Xia
A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models
Woojeong Jin, Yu Cheng, Yelong Shen et al.
Vision-Language Pretraining: Current Trends and the Future
Aishwarya Agrawal, Damien Teney, Aida Nematzadeh
Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation
Wenliang Dai, Lu Hou, Lifeng Shang et al.