conftrace_

cache-aware scheduling

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

virtual machine allocation (1) agent scheduling (1) cloud resource (1) large language model (1) context caching (1) long-context serving (1) cloud infrastructure (1) latency optimization (1) request scheduling (1) key-value cache (1)

Papers

Strata: Hierarchical Context Caching for Long Context Language Model Serving OSDI 2026 Kamino: Efficient VM Allocation at Scale with Latency-Driven Cache-Aware Scheduling OSDI 2025