CURP: Codebook-based Continuous User Representation for Personalized Generation with LLMs
Abstract
AbstractUser modeling characterizes individuals through their preferences and behavioral patterns to enable personalized simulation with Large Language Models (LLMs) in contemporary approaches. However, existing methods, whether personalized prompt-based or parameter-based methods, face challenges in balancing personalization quality against computational and data efficiency. We propose a novel framework CURP, which employs a bidirectional user encoder, a discrete prototype codebook and a dual-aggregator to extract both multi-dimensional user traits and query-aware user characteristic. This design enables plug-and-play personalization with a small number of trainable parameters (about 28M parameters, about 0.36% of the total model size). Through extensive experiments, we show that CURP achieves superior performance and generalization compared to strong baselines on the language model personalization (LaMP) benchmark, while offering better interpretability and robustness.