latency optimization

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices ICCV 2023 Enabling High Quality Real-Time Communications with Adaptive Frame-Rate NSDI 2023 FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer CVPR 2023 Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models Interspeech 2023 Non-autoregressive Streaming Transformer for Simultaneous Translation EMNLP 2023 Protego: Overload Control for Applications with Unpredictable Lock Contention NSDI 2023 Rethinking Vision Transformers for MobileNet Size and Speed ICCV 2023 RingLeader: Efficiently Offloading Intra-Server Orchestration to NICs NSDI 2023 SEPH: Scalable, Efficient, and Predictable Hashing on Persistent Memory OSDI 2023 Simultaneous Machine Translation with Tailored Reference EMNLP 2023 SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference ICCV 2023 SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture Search WACV 2023 Towards Real-Time Segmentation on the Edge AAAI 2023 Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023 Unleashing the Potential of Spiking Neural Networks with Dynamic Confidence ICCV 2023 Aquila: A unified, low-latency fabric for datacenter networks NSDI 2022 Backpressure Flow Control NSDI 2022 cISP: A Speed-of-Light Internet Service Provider NSDI 2022 Cocktail: A Multidimensional Optimization for Model Serving in Cloud NSDI 2022 Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation EMNLP 2022 EfficientFormer: Vision Transformers at MobileNet Speed NeurIPS 2022 Efficient Scheduling Policies for Microsecond-Scale Tasks NSDI 2022 FAERY: An FPGA-accelerated Embedding-based Retrieval System OSDI 2022 Findings of the WMT 2022 Shared Task on Efficient Translation EMNLP 2022 Learning Adaptive Segmentation Policy for End-to-End Simultaneous Translation ACL 2022