conftrace_

request orchestration

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

nic offload (1) programmable nic (1) intra-server scheduling (1) network interface card (1) end-to-end optimization (1) hardware-software co-design (1) semantic variable (1) llm application (1) data flow analysis (1) prompt annotation (1)

Papers

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable OSDI 2024 RingLeader: Efficiently Offloading Intra-Server Orchestration to NICs NSDI 2023