RoutePO: Personalized Routing Policy Optimization for LLM-based Multi-Channel Recall
Abstract
AbstractLLM-based rerankers in recommender systems are inherently constrained by limited context windows: they can only reorder a small retrieved candidate set, so any relevant item missed by upstream retrieval cannot be recovered at ranking time. To mitigate this dependency, we propose RoutePO, which repositions the LLM from an item ranker to a recall strategy router for multi-channel recall. Conditioned on a user’s profile/context (interaction history and optional demographics), the LLM outputs personalized fusion weights over heterogeneous retrieval experts, enabling dynamic candidate aggregation without exposing long candidate lists from the entire item pool to the prompt. We train the router via a synergistic two-stage alignment process: Coarse Routing Alignment (SFT) warm-starts the policy with a quality-aware oracle prior over retrieval experts, and Fine-grained Metric Optimization (RL) directly optimizes recall-stage ranking metrics (e.g., NDCG) by sampling simplex-valued routing weights and rewarding fused-list quality. To support continuous exploration over the simplex under GRPO-style optimization, we introduce SofT-GRPO based on Gumbel–Softmax reparameterization with nucleus restriction and KL regularization. Finally, we instantiate fusion with both weighted score merging and a weight-aware interleaving strategy (Snake Fusion) that preserves within-channel rankings. Experiments on three real-world datasets demonstrate consistent gains over strong individual recallers and multi-channel fusion baselines, including up to 15.88% relative improvement in NDCG@50 on Food. Our implementation is available on https://github.com/zhengzaiyi/RoutePO.