conftrace_

visual instruction tuning

35 papers

Explore in graph

Also known as

VIT

Co-occurring keywords

multimodal learning (4645) multimodal large language model (966) vision-language model (2348) vision language model (767) large language model (13587) zero-shot learning (3650) large multimodal model (184) instruction tuning (838) question answering (2963) visual question answering (1017)

Papers

Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation WACV 2026
KSS-MoE: Knowledge Space Synergy Framework in Mixture of Experts for Continual Visual Instruction Tuning AAAI 2026
Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness ICCV 2025
Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference ACL 2025
Tracing Training Footprints: A Calibration Approach for Membership Inference Attacks Against Multimodal Large Language Models EMNLP 2025
SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuning ICCV 2025
ContextFace: Generating Facial Expressions from Emotional Contexts ICCV 2025
Corrupted but Not Broken: Understanding and Mitigating the Negative Impacts of Corrupted Data in Visual Instruction Tuning EMNLP 2025
LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models CVPR 2025
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering ACL 2025
Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularization AACL 2025
Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment CVPR 2025
Filter Images First, Generate Instructions Later: Pre-Instruction Data Selection for Visual Instruction Tuning CVPR 2025
What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Instruction Tuning COLING 2025
Gla-AI4BioMed at RRG24: Visual Instruction-tuned Adaptation for Radiology Report Generation ACL 2024
Osprey: Pixel Understanding with Visual Instruction Tuning CVPR 2024
EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning CVPR 2024
TRINS: Towards Multimodal Language Models that Can Read CVPR 2024
Improved Baselines with Visual Instruction Tuning CVPR 2024
Biomedical Visual Instruction Tuning with Clinician Preference Alignment NIPS 2024
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models NIPS 2024
Tag-grounded Visual Instruction Tuning with Retrieval Augmentation EMNLP 2024
Step Differences in Instructional Video CVPR 2024
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data ACL 2024
Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning ACL 2024