Skip to content
conftrace_

visual instruction tuning

42 papers

VIT

Papers

Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation WACV 2026 FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistants CVPR 2026 Harmonious Parameter Adaptation in Continual Visual Instruction Tuning for Safety-Aligned MLLMs CVPR 2026 KSS-MoE: Knowledge Space Synergy Framework in Mixture of Experts for Continual Visual Instruction Tuning AAAI 2026 LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning CVPR 2026 Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference ACL 2025 ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wild COLING 2025 ContextFace: Generating Facial Expressions from Emotional Contexts ICCV 2025 Corrupted but Not Broken: Understanding and Mitigating the Negative Impacts of Corrupted Data in Visual Instruction Tuning EMNLP 2025 Filter Images First, Generate Instructions Later: Pre-Instruction Data Selection for Visual Instruction Tuning CVPR 2025 IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model ICLR 2025 LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models ICLR 2025 LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering ACL 2025 LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models CVPR 2025 MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning ICLR 2025 Reconstructive Visual Instruction Tuning ICLR 2025 Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness ICCV 2025 SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuning ICCV 2025 Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment CVPR 2025 Tracing Training Footprints: A Calibration Approach for Membership Inference Attacks Against Multimodal Large Language Models EMNLP 2025 What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Instruction Tuning COLING 2025 Biomedical Visual Instruction Tuning with Clinician Preference Alignment NeurIPS 2024 Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs NeurIPS 2024 CoLLaVO: Crayon Large Language and Vision mOdel ACL 2024 EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning CVPR 2024