Auto-reconfiguration for Latency Minimization in CPU-based DNN Serving

Ankit Bhardwaj; Amar Phanishayee; Deepak Narayanan; Ryan Stutsman

2025 ICML ICML 2025

Auto-reconfiguration for Latency Minimization in CPU-based DNN Serving

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Ankit Bhardwaj, Amar Phanishayee, Deepak Narayanan, Ryan Stutsman

Topics

Machine Learning > Application Areas > Efficient Computing

Keywords

inference latency batch size cpu-based servers dnn serving intra-operator parallelism threads

Download PDF