OSDI 2024

53 papers

MonoNN: Enabling a New Monolithic Optimization Space for Neural Network Inference Tasks on Modern GPU-Centric Architectures

Donglin Zhuang, Zhen Zheng, Haojun Xia, Xiafei Qiu, Junjie Bai

Fairness in Serving Large Language Models

Ying Sheng, Shiyi Cao, Dacheng Li, Banghua Zhu, Zhuohan Li

USHER: Holistic Interference Avoidance for Resource Optimized ML Inference

Sudipta Saha Shubha, Haiying Shen, Anand Iyer

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang

dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving

Bingyang Wu, Ruidong Zhu, Zili Zhang, peng sun, Xuanzhe Liu

Identifying On-/Off-CPU Bottlenecks Together with Blocked Samples

Minwoo Ahn, Jeongmin Han, Youngjin Kwon, Jinkyu Jeong

IronSpec: Increasing the Reliability of Formal Specifications

Eli Goldweber, Weixin Yu, Seyed Armin Vakil Ghahani, Manos Kapritsos

Performance Interfaces for Hardware Accelerators

Jiacheng Ma, Rishabh Iyer, Sahand Kashani, Mahyar Emami, Thomas Bourgeat

Inductive Invariants That Spark Joy: Using Invariant Taxonomies to Streamline Distributed Protocol Proofs

Tony Nuda Zhang, Travis Hance, Manos Kapritsos, Tej Chajed, Bryan Parno

Detecting Logic Bugs in Database Engines via Equivalent Expression Transformation

Zu-Ming Jiang, Zhendong Su

Motor: Enabling Multi-Versioning for Distributed Transactions on Disaggregated Memory

Ming Zhang, Yu Hua, Zhijun Yang

Burstable Cloud Block Storage with Data Processing Units

Junyi Shu, Kun Qian, Ennan Zhai, Xuanzhe Liu, Xin Jin

Massively Parallel Multi-Versioned Transaction Processing

Shujian Qian, Ashvin Goel

FairyWREN: A Sustainable Cache for Emerging Write-Read-Erase Flash Interfaces

Sara Mcallister, Yucong "Sherry" Wang, Benjamin Berg, Daniel S. Berger, George Amvrosiadis

Flock: A Framework for Deploying On-Demand Distributed Trust

Darya Kaviani, Sijun Tan, Pravein Govindan Kannan, Raluca Ada Popa

Secret Key Recovery in a Global-Scale End-to-End Encryption System

Graeme Connell, Vivian Fang, Rolfe Schmidt, Emma Dauterman, Raluca Ada Popa

Ransom Access Memories: Achieving Practical Ransomware Protection in Cloud with DeftPunk

Zhongyu Wang, Yaheng Song, Erci Xu, Haonan Wu, Guangxun Tong

DSig: Breaking the Barrier of Signatures in Data Centers

Marcos K. Aguilera, Clément Burgelin, Rachid Guerraoui, Antoine Murat, Athanasios Xygkis

Anvil: Verifying Liveness of Cluster Management Controllers

Xudong Sun, Wenjie Ma, Jiawei Tyler Gu, Zicheng Ma, Tej Chajed

Using Dynamically Layered Definite Releases for Verifying the RefFS File System

Mo Zou, Dong Du, Mingkai Dong, Haibo Chen

Validating the eBPF Verifier via State Embedding

Hao Sun, Zhendong Su

VeriSMo: A Verified Security Module for Confidential VMs

Ziqiao Zhou, Anjali, Weiteng Chen, Sishuai Gong, Chris Hawblitzel

Automatically Reasoning About How Systems Code Uses the CPU Cache

Rishabh Iyer, Katerina Argyraki, George Candea

MAST: Global Scheduling of ML Training across Geo-Distributed Datacenters at Hyperscale

Arnab Choudhury, Yang Wang, Tuomas Pelkonen, Kutta Srinivasan, Abha Jain

ServiceLab: Preventing Tiny Performance Regressions at Hyperscale through Pre-Production Testing

Mike Chow, Yang Wang, William Wang, Ayichew Hailu, Rohan Bopardikar

μSlope: High Compression and Fast Search on Semi-Structured Logs

Rui Wang, Devin Gibson, Kirk Rodrigues, Yu Luo, Yun Zhang

Optimizing Resource Allocation in Hyperscale Datacenters: Scalability, Usability, and Experiences

Neeraj Kumar, Pol Mauri Ruiz, Vijay Menon, Igor Kabiljo, Mayank Pundir

When will my ML Job finish? Toward providing Completion Time Estimates through Predictability-Centric Scheduling

Abdullah Bin Faisal, Noah Martin, Hafiz Mohsin Bashir, Swaminathan Lamelas, Fahad R. Dogar

Microkernel Goes General: Performance and Compatibility in the HongMeng Production Microkernel

Haibo Chen, Xie Miao, Ning Jia, Nan Wang, Yu Li

Data-flow Availability: Achieving Timing Assurance in Autonomous Systems

Ao Li, Ning Zhang

IntOS: Persistent Embedded Operating System and Language Support for Multi-threaded Intermittent Computing

Yilun Wu, Byounguk Min, Mohannad Ismail, Wenjie Xiong, Changhee Jung

High-throughput and Flexible Host Networking for Accelerated Computing

Athinagoras Skiadopoulos, Zhiqiang Xie, Mark Zhao, Qizhe Cai, Saksham Agarwal

SquirrelFS: using the Rust compiler to check file-system crash consistency

Hayley LeBlanc, Nathan Taylor, James Bornholt, Vijay Chidambaram

ChameleonAPI: Automatic and Efficient Customization of Neural Networks for ML Applications

Yuhan Liu, Chengcheng Wan, Kuntai Du, Henry Hoffmann, Junchen Jiang

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu

Caravan: Practical Online Learning of In-Network ML Models with Labeling Agents

Qizheng Zhang, Ali Imran, Enkeleda Bardhi, Tushar Swamy, Nathan Zhang

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue

Enabling Tensor Language Model to Assist in Generating High-Performance Tensor Programs for Deep Learning

Yi Zhai, Sijia Yang, Keyu Pan, Renwei Zhang, Shuo Liu

Chop Chop: Byzantine Atomic Broadcast to the Network Limit

Martina Camaioni, Rachid Guerraoui, Matteo Monti, Pierre-Louis Roman, Manuel Vidigueira

Fast and Scalable In-network Lock Management Using Lock Fission

Hanze Zhang, Ke Cheng, Rong Chen, Haibo Chen

Beaver: Practical Partial Snapshots for Distributed Cloud Services

Liangcheng Yu, Xiao Zhang, Haoran Zhang, John Sonchack, Dan Ports

ACCL+: an FPGA-Based Collective Engine for Distributed Applications

Zhenhao He, Dario Korolija, Yu Zhu, Benjamin Ramhorst, Tristan Laan

DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving

Yinmin Zhong, Shengyu Liu, Junda Chen, Jianbo Hu, Yibo Zhu

Llumnix: Dynamic Scheduling for Large Language Model Serving

Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

Wonbeom Lee, Jungi Lee, Junghwan Seo, Jaewoong Sim

ServerlessLLM: Low-Latency Serverless Inference for Large Language Models

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov

Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve

Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra

DRust: Language-Guided Distributed Shared Memory with Fine Granularity, Full Transparency, and Ultra Efficiency

Haoran Ma, Yifan Qiao, Shi Liu, Shan Yu, Yuanjiang Ni

A Tale of Two Paths: Toward a Hybrid Data Plane for Efficient Far-Memory Applications

Lei Chen, Shi Liu, Chenxi Wang, Haoran Ma, Yifan Qiao

Harvesting Memory-bound CPU Stall Cycles in Software with MSH

Zhihong Luo, Sam Son, Sylvia Ratnasamy, Scott Shenker

Managing Memory Tiers with CXL in Virtualized Environments

Yuhong Zhong, Daniel S. Berger, Carl Waldspurger, Ryan Wee, Ishwar Agarwal

Nomad: Non-Exclusive Memory Tiering via Transactional Page Migration

Lingfeng Xiang, Zhen Lin, Weishu Deng, Hui Lu, Jia Rao

Sabre: Hardware-Accelerated Snapshot Compression for Serverless MicroVMs

Nikita Lazarev, Varun Gohil, James Tsai, Andy Anderson, Bhushan Chitlur