BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute

Dujian Ding; Ankur Mallick; Shaokun Zhang; Chi Wang; Daniel Madrigal; Mirian Del Carmen Hipolito Garcia; Menglin Xia; Laks V. S. Lakshmanan; Qingyun Wu; Victor Rühle

2025 ICML ICML 2025

BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Del Carmen Hipolito Garcia, Menglin Xia, Laks V. S. Lakshmanan, Qingyun Wu, Victor Rühle

Topics

Machine Learning > Application Areas > Efficient Computing Natural Language Processing > Generation > Text Generation Artificial Intelligence > Core AI > Large Language Models

Keywords

cost saving query routing large language model multiple response performance drop optimal compute

Download PDF