← Back to papers
2023 INTERSPEECH INTERSPEECH 2023

Fast Enrollable Streaming Keyword Spotting System: Training and Inference using a Web Browser

Abstract

When a keyword spotting system is deployed on heavily personalized platforms such as digital humans, a few issues occur such as 1) a lack of training data when registering user-defined keywords, 2) a desire to reduce computation and minimize latency, and 3) the inability to immediately train and test the keyword-spotting model. We address the issues through 1) a keyword-spotting system based on a speech embedding model, 2) streamable system with duplicate computations removed, and 3) real-time inference in a web browser using WebAssembly.

🌉 Interdisciplinary Bridge — Deep Learning and Machine Learning and Speech & Audio
🧭 Keyword Pioneer — streaming system
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Deep Learning, Healthcare & Medicine, Interdisciplinary, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Namhyun Cho , Sunmin Kim , Yoseb Kang , Heeman Kim

Topics

Machine Learning > Core Methods > Representation Learning Deep Learning > Techniques > Model Architecture Speech & Audio > Recognition > Speech Recognition Machine Learning > Learning Types > Transfer Learning

Keywords

keyword spotting real-time inference speech embedding streaming model streaming system web browser
Download PDF

Related papers

Multimodal Turn-Taking Model Using Visual Cues for End-of-Utterance Prediction in Spoken Dialogue Systems 2023
Audio-Visual Praise Estimation for Conversational Video based on Synchronization-Guided Multimodal Transformer 2023
Improving the response timing estimation for spoken dialogue systems by reducing the effect of speech recognition delay 2023
Improving Code-Switching and Name Entity Recognition in ASR with Speech Editing based Data Augmentation 2023
What are differences? Comparing DNN and Human by Their Performance and Characteristics in Speaker Age Estimation 2023