confidence-based cascade

cost accuracy tradeoff (1) cascaded inference (1) taxonomy-guided selection (1) confidence-based routing (1) large language model (1) cascade inference (1) cost optimization (1) inference cost (1) model routing (1) retrieval-augmented generation (1)