latency optimization

Microsecond-scale Preemption for Concurrent GPU-accelerated DNN Inferences OSDI 2022 Minimum latency training of sequence transducers for streaming end-to-end speech recognition Interspeech 2022 Modeling Dual Read/Write Paths for Simultaneous Machine Translation ACL 2022 PowerTCP: Pushing the Performance Limits of Datacenter Networks NSDI 2022 SmartAdapt: Multi-Branch Object Detection Framework for Videos on Mobiles CVPR 2022 Structural Pruning via Latency-Saliency Knapsack NeurIPS 2022 Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection NAACL 2022 Cost-effective Cloud Edge Traffic Engineering with Cascara NSDI 2021 Cross Attention Augmented Transducer Networks for Simultaneous Translation EMNLP 2021 Dynamic Encoder Transducer: A Flexible Solution for Trading Off Accuracy for Latency Interspeech 2021 Efficient Machine Translation with Model Pruning and Quantization EMNLP 2021 Findings of the WMT 2021 Shared Task on Efficient Translation EMNLP 2021 Flexi-Transducer: Optimizing Latency, Accuracy and Compute for Multi-Domain On-Device Scenarios Interspeech 2021 Flightplan: Dataplane Disaggregation and Placement for P4 Programs NSDI 2021 HAWQ-V3: Dyadic Neural Network Quantization ICML 2021 Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translation Interspeech 2021 iNAS: Integral NAS for Device-Aware Salient Object Detection ICCV 2021 Move Fast and Meet Deadlines: Fine-grained Real-time Stream Processing with Cameo NSDI 2021 Optimizing Storage Performance with Calibrated Interrupts OSDI 2021 Searching for Fast Model Families on Datacenter Accelerators CVPR 2021 Simultaneous Neural Machine Translation with Constituent Label Prediction EMNLP 2021 Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy EMNLP 2021 When to Hedge in Interactive Services NSDI 2021 Accelerating Ranking in E-Commerce Search Engines through Contextual Factor Selection AAAI 2020 Adapting TCP for Reconfigurable Datacenter Networks NSDI 2020