latency reduction

eZNS: An Elastic Zoned Namespace for Commodity ZNS SSDs OSDI 2023 Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models EMNLP 2023 Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation ACL 2023 No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation ICML 2023 Personalized Predictive ASR for Latency Reduction in Voice Assistants Interspeech 2023 Practical Network Acceleration With Tiny Sets CVPR 2023 Scaling Neural Face Synthesis to High FPS and Low Latency by Neural Caching WACV 2023 ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer NeurIPS 2023 ShRing: Networking with Shared Receive Rings OSDI 2023 Speculative Decoding with Big Little Decoder NeurIPS 2023 Spike-Based Anytime Perception WACV 2023 Anticipation-Free Training for Simultaneous Machine Translation ACL 2022 From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation Interspeech 2022 Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies Interspeech 2022 Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue ACL 2022 Selective Network Linearization for Efficient Private Inference ICML 2022 SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022 Structured Pruning Learns Compact and Accurate Models ACL 2022 Amortized Neural Networks for Low-Latency Speech Recognition Interspeech 2021 DeepReDuce: ReLU Reduction for Fast Private Inference ICML 2021 Device-Based LTE Latency Reduction at the Application Layer NSDI 2021 FracBits: Mixed Precision Quantization via Fractional Bit-Widths AAAI 2021 HMM-Free Encoder Pre-Training for Streaming RNN Transducer Interspeech 2021 Vector Quantized Bayesian Neural Network Inference for Data Streams AAAI 2021 Dynamic Sentence Boundary Detection for Simultaneous Translation ACL 2020