conftrace_

latency optimization

119 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural architecture search (666) simultaneous translation (136) large language model (13587) throughput optimization (46) tail latency (25) congestion control (43) simultaneous machine translation (48) translation quality (224) convolutional neural network (4226)

Papers

Delay-penalized CTC Implemented Based on Finite State Transducer INTERSPEECH 2023
Bolt: Sub-RTT Congestion Control for Ultra-Low Latency NSDI 2023
SEPH: Scalable, Efficient, and Predictable Hashing on Persistent Memory OSDI 2023
Simultaneous Machine Translation with Tailored Reference EMNLP 2023
Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models INTERSPEECH 2023
Protego: Overload Control for Applications with Unpredictable Lock Contention NSDI 2023
FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer CVPR 2023
Chanakya: Learning Runtime Decisions for Adaptive Real-Time Perception NIPS 2023
An Efficient Conversational Smart Compose System ACL 2023
Towards Real-Time Segmentation on the Edge AAAI 2023
FAERY: An FPGA-accelerated Embedding-based Retrieval System OSDI 2022
PowerTCP: Pushing the Performance Limits of Datacenter Networks NSDI 2022
SmartAdapt: Multi-Branch Object Detection Framework for Videos on Mobiles CVPR 2022
Aquila: A unified, low-latency fabric for datacenter networks NSDI 2022
Backpressure Flow Control NSDI 2022
Cocktail: A Multidimensional Optimization for Model Serving in Cloud NSDI 2022
Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection NAACL 2022
Learning Adaptive Segmentation Policy for End-to-End Simultaneous Translation ACL 2022
cISP: A Speed-of-Light Internet Service Provider NSDI 2022
Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation EMNLP 2022
EfficientFormer: Vision Transformers at MobileNet Speed NIPS 2022
Structural Pruning via Latency-Saliency Knapsack NIPS 2022
Microsecond-scale Preemption for Concurrent GPU-accelerated DNN Inferences OSDI 2022
Findings of the WMT 2022 Shared Task on Efficient Translation EMNLP 2022
Efficient Scheduling Policies for Microsecond-Scale Tasks NSDI 2022