conftrace_

latency slo

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

learning-based controller (1) performance target (1) cpu throttle ratio (1) inference serving (1) resource utilization (1) gpu optimization (1) interference-aware scheduling (1) model batching (1) gpu resource management (1) interference avoidance (1)

Papers

Autothrottle: A Practical Bi-Level Approach to Resource Management for SLO-Targeted Microservices NSDI 2024 USHER: Holistic Interference Avoidance for Resource Optimized ML Inference OSDI 2024