conftrace_

visual instruction tuning

42 papers

Explore in graph

Also known as

VIT

Co-occurring keywords · papers mentioning both

vision-language model (17) multimodal large language model (16) multimodal learning (14) large language model (7) zero-shot learning (6) large multimodal model (4) instruction tuning (4) question answering (4) catastrophic forgetting (4) parameter-efficient fine-tuning (3)

Papers

Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data ACL 2024 Gla-AI4BioMed at RRG24: Visual Instruction-tuned Adaptation for Radiology Report Generation ACL 2024 Improved Baselines with Visual Instruction Tuning CVPR 2024 LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning CVPR 2024 MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding CVPR 2024 Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models NeurIPS 2024 Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models ACL 2024 Osprey: Pixel Understanding with Visual Instruction Tuning CVPR 2024 Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos CVPR 2024 Step Differences in Instructional Video CVPR 2024 Tag-grounded Visual Instruction Tuning with Retrieval Augmentation EMNLP 2024 TRINS: Towards Multimodal Language Models that Can Read CVPR 2024 TroL: Traversal of Layers for Large Language and Vision Models EMNLP 2024 Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning ACL 2024 Visual Instruction Tuning with Polite Flamingo AAAI 2024 Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing NeurIPS 2024 Visual Instruction Tuning NeurIPS 2023