latency optimization

WHALE-FL: Wireless and Heterogeneity Aware Latency Efficient Federated Learning over Mobile Devices via Adaptive Subnetwork Scheduling AAAI 2025 Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Framework ICLR 2024 ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction NeurIPS 2024 AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation NeurIPS 2024 BASS: Batched Attention-optimized Speculative Sampling ACL 2024 CHISEL: An optical slice of the wide-area network NSDI 2024 Context Consistency between Training and Inference in Simultaneous Machine Translation ACL 2024 DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving OSDI 2024 Efficient Contextual LLM Cascades through Budget-Constrained Policy Learning NeurIPS 2024 How Speculative Can Speculative Decoding Be? COLING 2024 Load is not what you should balance: Introducing Prequal NSDI 2024 POSEIDON: A Consolidated Virtual Network Controller that Manages Millions of Tenants via Config Tree NSDI 2024 RepTor: Re-parameterizable Temporal Convolution for Keyword Spotting via Differentiable Kernel Search Interspeech 2024 RepViT: Revisiting Mobile CNN From ViT Perspective CVPR 2024 ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency EMNLP 2024 StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection ACL 2024 TANGO: Secure Collaborative Route Control across the Public Internet NSDI 2024 Threshold-driven Pruning with Segmented Maximum Term Weights for Approximate Cluster-based Sparse Retrieval EMNLP 2024 Vulcan: Automatic Query Planning for Live ML Analytics NSDI 2024 An Efficient Conversational Smart Compose System ACL 2023 A New ANN-SNN Conversion Method with High Accuracy, Low Latency and Good Robustness IJCAI 2023 BAT: Boundary aware transducer for memory-efficient and low-latency ASR Interspeech 2023 Bolt: Sub-RTT Congestion Control for Ultra-Low Latency NSDI 2023 Chanakya: Learning Runtime Decisions for Adaptive Real-Time Perception NeurIPS 2023 Delay-penalized CTC Implemented Based on Finite State Transducer Interspeech 2023