conftrace_

latency reduction

77 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) inference efficiency (248) simultaneous translation (136) streaming speech recognition (40) speech recognition (1226) edge computing (210) inference optimization (219) throughput optimization (46) language model (4599)

Papers

No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation ICML 2023
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer NIPS 2023
From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation INTERSPEECH 2022
Selective Network Linearization for Efficient Private Inference ICML 2022
Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue ACL 2022
SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022
Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies INTERSPEECH 2022
Structured Pruning Learns Compact and Accurate Models ACL 2022
Anticipation-Free Training for Simultaneous Machine Translation ACL 2022
DeepReDuce: ReLU Reduction for Fast Private Inference ICML 2021
Device-Based LTE Latency Reduction at the Application Layer NSDI 2021
FracBits: Mixed Precision Quantization via Fractional Bit-Widths AAAI 2021
HMM-Free Encoder Pre-Training for Streaming RNN Transducer INTERSPEECH 2021
Vector Quantized Bayesian Neural Network Inference for Data Streams AAAI 2021
Amortized Neural Networks for Low-Latency Speech Recognition INTERSPEECH 2021
Low Latency Speech Recognition Using End-to-End Prefetching INTERSPEECH 2020
Fast and Slow Acoustic Model INTERSPEECH 2020
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework EMNLP 2020
Opportunistic Decoding with Timely Correction for Simultaneous Translation ACL 2020
Dynamic Sentence Boundary Detection for Simultaneous Translation ACL 2020
InstaNAS: Instance-Aware Neural Architecture Search AAAI 2020
Parallel Rescoring with Transformer for Streaming On-Device Speech Recognition INTERSPEECH 2020
Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selection INTERSPEECH 2020
StrObe: Streaming Object Detection from LiDAR Packets CORL 2020
Communication Compression for Decentralized Training NIPS 2018