vision-language alignment

69 papers

Explore in graph

Also known as

VLA VL

Co-occurring keywords

multimodal learning (4622) vision-language model (2235) contrastive learning (3979) zero-shot learning (3637) representation learning (6174) multimodal large language model (865) multi-modal learning (1276) image-text alignment (109) large language model (12755) image captioning (728)

Papers

Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models NIPS 2024

Slot-VLM: Object-Event Slots for Video-Language Modeling NIPS 2024

DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback CVPR 2024

CPLIP: Zero-Shot Learning for Histopathology with Comprehensive Vision-Language Alignment CVPR 2024

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs NIPS 2024

Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval AAAI 2023

FashionSAP: Symbols and Attributes Prompt for Fine-Grained Fashion Vision-Language Pre-Training CVPR 2023

RCA-NOC: Relative Contrastive Alignment for Novel Object Captioning ICCV 2023

On the Difference of BERT-style and CLIP-style Text Encoders ACL 2023

Open Vocabulary Semantic Segmentation With Patch Aligned Contrastive Learning CVPR 2023

Hierarchical Semantic Correspondence Networks for Video Paragraph Grounding CVPR 2023

Detecting Everything in the Open World: Towards Universal Object Detection CVPR 2023

Semantics-Aware Dynamic Localization and Refinement for Referring Image Segmentation AAAI 2023

LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following EMNLP 2023

RefEgo: Referring Expression Comprehension Dataset from First-Person Perception of Ego4D ICCV 2023

Contrastive Learning with Expectation-Maximization for Weakly Supervised Phrase Grounding EMNLP 2022

Scene-Text Aware Image and Text Retrieval with Dual-Encoder ACL 2022

CLIP4IDC: CLIP for Image Difference Captioning IJCNLP 2022

FOIL it! Find One mismatch between Image and Language caption ACL 2017