Papers
No Buffer, No Bottleneck: Efficient Zero-Copy KV Cache Offloading for Long-Context LLMs
Shutian Luo, Haiying Shen
ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs
Guangda Liu, Wenhao Chen, Chengwei Li et al.
Strata: Hierarchical Context Caching for Long Context Language Model Serving
Zhiqiang Xie, Ziyi Xu, Mark Zhao et al.
FRCC: Towards Provably Fair and Robust Congestion Control
Anup Agarwal, Venkat Arun, Srinivasan Seshan
Net-P4ct: Enhanced WAN Bandwidth Fair Sharing Using P4 Programmable Switches
Haoran Chen, Mingwei Cui, Yihan Zou et al.
Syntra: Synthesizing Cross-Layer Controllers for Low-Latency Video Streaming
Jia Pan, Anup Agarwal, Işıl Dillig et al.
OneSidedMW: Managing Disaggregated Memory Efficiently, Flexibly, and Securely with RNIC Offloading
Zixuan Wang, Jinyu Gu, Xingda Wei et al.
KRAKENGUARD: Towards Fine-Grained eBPF Isolation
Jainil Patel, Lucas Graeff Buhl-Nielsen, Adrien Ghosn et al.
Cost-effective and Reliable Global Internet Peering with Programmable Switches
Congcong Miao, Zhiyi Yao, Jianchao Lv et al.
Co-Designing Traffic Control with NVMe-oF for Disaggregated Storage: A Comparative Study of Switched and Switchless SAN Architectures
Chendong Wang, Joontaek Oh, Ming Liu
HyperEdge: An Edge CDN Infrastructure for Cost Efficient Video Streaming
Dehui Wei, Jiao Zhang, Haozhe Li et al.
XLL: Cross-Layer Logging for Data Deduplication in Consensus-Based Storage
John Shawger, Arnav Jhingran, Andrea Arpaci-Dusseau et al.
HCDN: Coordinated Stream Scheduling for Cost-Effective Live Video Delivery
Liying Wang, Jing Liu, Yuhan Zhou et al.
AnyPro: Preference-Preserving Anycast Optimization based on Strategic AS-Path Prepending
Minyuan Zhou, Yuning Chen, Jiaqi Zheng et al.
Offloading Cloud Network Services at Production Scale with SONiC DASH SmartSwitch
Shaofeng Wu, Zhixiong Niu, Riff Jiang et al.
Medley: Optimizing Midgress Bandwidth for Commercial Live Streaming CDNs
Haiping Wang, Wanxin Shi, Sandesh Dhawaskar Sathyanarayana et al.
HeteCCL: Synthesizing Near-Optimal Collective Communication Schedules for Heterogeneous GPU Clusters
Chenyang Hei, Fuliang Li, Jiayi Li et al.
FAST: An Efficient Scheduler for All-to-All GPU Communication
Yiran Lei, Dongjoo Lee, Liangyu Zhao et al.
Mitigating CPU Frontend for Complex Data Plane Applications
Yihan Dang, Hao Li, Ze Xia et al.
Hierarchical Integration of WebAssembly in Serverless for Efficiency and Interoperability
Mohammadamin Baqershahi, Changyuan Lin, Visal Saosuo et al.
Queue-Mem: Energy-Efficient Hardware Storage for Advanced Network Function Acceleration
Mariano Scazzariello, Tommaso Caiazzi, Hamid Ghasemirahni et al.
Agentix: An Efficient Serving Engine for LLM Agents as General Programs
Michael Luo, Xiaoxiang Shi, Colin Cai et al.
Unleashing The Potential of Datacenter SSDs by Taming Performance Variability
Gohar Irfan Chaudhry, Ankit Bhardwaj, Zhenyuan (Zain) Ruan et al.
Cortex: Achieving Low-Latency, Cost-Efficient Remote Data Access For LLM via Semantic-Aware Knowledge Caching
Chaoyi Ruan, Chao Bi, Kaiwen Zheng et al.
Latency-Aware Caching with Delayed Hits: From Bursty Traffic to Pipeline Architectures
Nadav Keren, Gil Einziger, Gabriel Scalosub