FLUID-V: Elastic-Horizon Diffusion Decoding for Vision-Language Models
Abstract
AbstractAutoregressive vision-language models achieve strong multimodal understanding, but their sequential decoding becomes increasingly inefficient as multimodal responses grow longer. Adapting AR-VLMs to diffusion-style block decoding is promising, yet fixed refinement blocks struggle with sharply varying multimodal uncertainty in OCR, chart, document, and reasoning-heavy outputs. Binary mask-or-token states further limit local refinement, as masking discards partial evidence while premature commitment can corrupt the causal prefix. We present FLUID-V, a lightweight AR-to-diffusion adaptation framework for reliable local multimodal refinement. FLUID-V selects refinement spans with elastic horizons and represents unresolved positions as evolving soft semantic mixtures in embedding space. Only confident predictions are committed to the persistent KV cache, preserving causal multimodal conditioning and autoregressive compatibility. Experiments with OpenPangu-VL-7B and 100K self-distilled samples show competitive performance across diverse multimodal benchmarks, with ablations confirming the importance of adaptive horizons and stateful intermediate representations. Our code is available at https://github.com/Oli-lab-nun/FLUID-V.