conftrace_

throughput optimization

46 papers

Explore in graph

Co-occurring keywords

latency optimization (119) inference optimization (219) large language model (13587) model compression (3302) latency reduction (77) tail latency (25) resource allocation (251) efficient inference (233) congestion control (43) datacenter networking (18)

Papers

MIMONets: Multiple-Input-Multiple-Output Neural Networks Exploiting Computation in Superposition NIPS 2023
Protego: Overload Control for Applications with Unpredictable Lock Contention NSDI 2023
Backpressure Flow Control NSDI 2022
Microsecond-scale Preemption for Concurrent GPU-accelerated DNN Inferences OSDI 2022
Findings of the WMT 2022 Shared Task on Efficient Translation EMNLP 2022
CodedBulk: Inter-Datacenter Bulk Transfers using Network Coding NSDI 2021
Prism: Proxies without the Pain NSDI 2021
Efficient Machine Translation with Model Pruning and Quantization EMNLP 2021
Optimizing Storage Performance with Calibrated Interrupts OSDI 2021
BMC: Accelerating Memcached using Safe In-kernel Caching and Pre-stack Processing NSDI 2021
Findings of the WMT 2021 Shared Task on Efficient Translation EMNLP 2021
RackSched: A Microsecond-Scale Scheduler for Rack-Scale Computers OSDI 2020
Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads OSDI 2020
Achieving 100Gbps Intrusion Prevention on a Single Server OSDI 2020
Protean: VM Allocation Service at Scale OSDI 2020
Thunderbolt: Throughput-Optimized, Quality-of-Service-Aware Power Capping at Scale OSDI 2020
wPerf: Generic Off-CPU Analysis to Identify Bottleneck Waiting Events OSDI 2018
Multi-Path Transport for RDMA in Datacenters NSDI 2018
Copa: Practical Delay-Based Congestion Control for the Internet NSDI 2018
On-the-fly Operation Batching in Dynamic Computation Graphs NIPS 2017
Yak: A High-Performance Big-Data-Friendly Garbage Collector OSDI 2016