latency optimization

A General Framework for Adaptation of Neural Machine Translation to Simultaneous Translation AACL 2020 AIFM: High-Performance, Application-Integrated Far Memory OSDI 2020 Caladan: Mitigating Interference at Microsecond Timescales OSDI 2020 CryptoNAS: Private Inference on a ReLU Budget NeurIPS 2020 Incremental Text to Speech for Neural Sequence-to-Sequence Models Using Reinforcement Learning Interspeech 2020 Learning Adaptive Segmentation Policy for Simultaneous Translation EMNLP 2020 MnasFPN: Learning Latency-Aware Pyramid Architecture for Object Detection on Mobile Devices CVPR 2020 Near-Optimal Latency Versus Cost Tradeoffs in Geo-Distributed Storage NSDI 2020 Serving DNNs like Clockwork: Performance Predictability from the Bottom Up OSDI 2020 Simultaneous Translation Policies: From Fixed to Adaptive ACL 2020 Towards Efficient Model Compression via Learned Global Ranking CVPR 2020 MnasNet: Platform-Aware Neural Architecture Search for Mobile CVPR 2019 Monotonic Infinite Lookback Attention for Simultaneous Machine Translation ACL 2019 Temporal Convolution for Real-Time Keyword Spotting on Mobile Devices Interspeech 2019 Andromeda: Performance, Isolation, and Velocity at Scale in Cloud Network Virtualization NSDI 2018 Odin: Microsoft’s Scalable Fault-Tolerant CDN Measurement System NSDI 2018 PCC Vivace: Online-Learning Congestion Control NSDI 2018 PRETZEL: Opening the Black Box of Machine Learning Prediction Serving Systems OSDI 2018 RobinHood: Tail Latency Aware Caching -- Dynamic Reallocation from Cache-Rich to Cache-Poor OSDI 2018 Clipper: A Low-Latency Online Prediction Serving System NSDI 2017 Live Video Analytics at Scale with Approximation and Delay-Tolerance NSDI 2017 EC-Cache: Load-Balanced, Low-Latency Cluster Caching with Online Erasure Coding OSDI 2016 Incremental Consistency Guarantees for Replicated Objects OSDI 2016 The SNOW Theorem and Latency-Optimal Read-Only Transactions OSDI 2016