low-latency inference

Deferred NAM: Low-latency Top-K Context Injection via Deferred Context Encoding for Non-Streaming ASR NAACL 2024 Knowledge boosting during low-latency inference Interspeech 2024 PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systems EMNLP 2024 ServerlessLLM: Low-Latency Serverless Inference for Large Language Models OSDI 2024 Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Networks AAAI 2024 Hybrid Neural Networks for On-Device Directional Hearing AAAI 2022 Low-Latency Online Streaming VideoQA Using Audio-Visual Transformers Interspeech 2022 Two-Pass Low Latency End-to-End Spoken Language Understanding Interspeech 2022 Amortized Neural Networks for Low-Latency Speech Recognition Interspeech 2021 Super-Human Performance in Online Low-Latency Recognition of Conversational Speech Interspeech 2021 Listen Attentively, and Spell Once: Whole Sentence Generation via a Non-Autoregressive Architecture for Low-Latency Speech Recognition Interspeech 2020 RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Network CVPR 2020 Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications EMNLP 2020