LE-Viz: Complementing Text Serialization with Visual Encoding of Structured Temporal Data for Cross-Distribution Generalization
Abstract
AbstractWhen large language models process structured temporal data, serialization into token sequences collapses the two-dimensional organization (Features * Time) that encodes meaningful relationships between co-occurring features. We investigate whether visual encoding can recover the structural information that linearization loses. We introduce LE-Viz, a framework that transforms longitudinal experiential data into complementary visual and textual representations for a vision-language model that generates prospective narratives, framing prediction as language generation. Evaluated on cross-distribution tasks across three datasets spanning mental health and educational forecasting, LE-Viz sets a new benchmark on a widely-adopted cross-distribution generalization task, improving over both the traditional state-of-the-art and the best text-only LLM baseline, and consistently outperforms all baselines. Analyses show that spatial organization of visual inputs, not information quantity, drives the generalization gain, and that the multimodal combination exceeds both text-only and vision-only conditions.