cascaded inference

cost accuracy tradeoff (1) confidence-based cascade (1) taxonomy-guided selection (1) confidence-based routing (1) large language model (1) cascade inference (1) cost optimization (1) inference cost (1) model routing (1) retrieval-augmented generation (1)