Interspeech 2020

1,035 papers

Attentive Convolutional Recurrent Neural Network Using Phoneme-Level Acoustic Representation for Rare Sound Event Detection

Shreya G. Upadhyay, Bo-Hao Su, Chi-Chun Lee

Multi-Talker ASR for an Unknown Number of Sources: Joint Training of Source Counting, Separation and ASR

Thilo von Neumann, Christoph Boeddeker, Lukas Drude, Keisuke Kinoshita, Marc Delcroix

Identify Speakers in Cocktail Parties with End-to-End Attention

Junzhe Zhu, Mark Hasegawa-Johnson, Leda Sarı

Towards Speech Robustness for Acoustic Scene Classification

Shuo Liu, Andreas Triantafyllopoulos, Zhao Ren, Bjorn W. Schuller

Audio-Visual Multi-Speaker Tracking Based on the GLMB Framework

Shoufeng Lin, Xinyuan Qian

Competing Speaker Count Estimation on the Fusion of the Spectral and Spatial Embedding Space

Chao Peng, Xihong Wu, Tianshu Qu

An Open-Source Voice Type Classifier for Child-Centered Daylong Recordings

Marvin Lavechin, Ruben Bousbib, Hervé Bredin, Emmanuel Dupoux, Alejandrina Cristia

Partial AUC Optimisation Using Recurrent Neural Networks for Music Detection with Limited Training Data

Pablo Gimeno, Victoria Mingote, Alfonso Ortega, Antonio Miguel, Eduardo Lleida

Recognize Mispronunciations to Improve Non-Native Acoustic Modeling Through a Phone Decoder Built from One Edit Distance Finite State Automaton

Wei Chu, Yang Liu, Jianwei Zhou

Context-Aware Goodness of Pronunciation for Computer-Assisted Pronunciation Training

Jiatong Shi, Nan Huo, Qin Jin

Automatic Detection of Accent and Lexical Pronunciation Errors in Spontaneous Non-Native English Speech

Konstantinos Kyriakopoulos, Kate M. Knill, Mark J.F. Gales

ASR-Free Pronunciation Assessment

Sitong Cheng, Zhixin Liu, Lantian Li, Zhiyuan Tang, Dong Wang

Pronunciation Erroneous Tendency Detection with Language Adversarial Represent Learning

Longfei Yang, Kaiqi Fu, Jinsong Zhang, Takahiro Shinozaki

Unsupervised Feature Adaptation Using Adversarial Multi-Task Training for Automatic Evaluation of Children’s Speech

Richeng Duan, Nancy F. Chen

An End-to-End Mispronunciation Detection System for L2 English Speech Leveraging Novel Anti-Phone Modeling

Bi-Cheng Yan, Meng-Che Wu, Hsiao-Tsung Hung, Berlin Chen

An Effective End-to-End Modeling Approach for Mispronunciation Detection

Tien-Hong Lo, Shi-Yan Weng, Hsiu-Jui Chang, Berlin Chen

Automatic Scoring at Multi-Granularity for L2 Pronunciation

Binghuai Lin, Liyuan Wang, Xiaoli Feng, Jinsong Zhang

Adversarial Domain Adaptation for Speaker Verification Using Partially Shared Network

Zhengyang Chen, Shuai Wang, Yanmin Qian

Speaker-Aware Linear Discriminant Analysis in Speaker Verification

Naijun Zheng, Xixin Wu, Jinghua Zhong, Xunying Liu, Helen Meng

An Effective Speaker Recognition Method Based on Joint Identification and Verification Supervisions

Ying Liu, Yan Song, Yiheng Jiang, Ian McLoughlin, Lin Liu

Unsupervised Training of Siamese Networks for Speaker Verification

Umair Khan, Javier Hernando

Multi-Task Learning for Voice Related Recognition Tasks

Ana Montalvo, Jose R. Calvo, Jean-Francois Bonastre

Weakly Supervised Training of Hierarchical Attention Networks for Speaker Identification

Yanpei Shi, Qiang Huang, Thomas Hain

Segment-Level Effects of Gender, Nationality and Emotion Information on Text-Independent Speaker Verification

Kai Li, Masato Akagi, Yibo Wu, Jianwu Dang

Meta-Learning for Short Utterance Speaker Recognition with Imbalance Length Pairs

Seong Min Kye, Youngmoon Jung, Hae Beom Lee, Sung Ju Hwang, Hoirin Kim

In Defence of Metric Learning for Speaker Recognition

Joon Son Chung, Jaesung Huh, Seongkyu Mun, Minjae Lee, Hee-soo Heo

One Model, Many Languages: Meta-Learning for Multilingual Text-to-Speech

Tomáš Nekvinda, Ondřej Dušek

Efficient Neural Speech Synthesis for Low-Resource Languages Through Multilingual Modeling

Marcel de Korte, Jaebok Kim, Esther Klabbers

Generic Indic Text-to-Speech Synthesisers with Rapid Adaptation in an End-to-End Framework

Anusha Prakash, Hema A. Murthy

On Improving Code Mixed Speech Synthesis with Mixlingual Grapheme-to-Phoneme Model

Shubham Bansal, Arijit Mukherjee, Sandeepkumar Satpal, Rupeshkumar Mehta

Tone Learning in Low-Resource Bilingual TTS

Ruolan Liu, Xue Wen, Chunhui Lu, Xiao Chen

Cross-Lingual Text-To-Speech Synthesis via Domain Adaptation and Perceptual Similarity Regression in Speaker Space

Detai Xin, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, Hiroshi Saruwatari

Phonological Features for 0-Shot Multilingual Speech Synthesis

Marlene Staib, Tian Huey Teh, Alexandra Torresquintero, Devang S. Ram Mohan, Lorenzo Foglianti

Dynamic Soft Windowing and Language Dependent Style Token for Code-Switching End-to-End Speech Synthesis

Ruibo Fu, Jianhua Tao, Zhengqi Wen, Jiangyan Yi, Chunyu Qiang

Multi-Lingual Multi-Speaker Text-to-Speech Synthesis for Voice Cloning with Online Speaker Enrollment

Zhaoyu Liu, Brian Mak

Towards Natural Bilingual and Code-Switched Speech Synthesis Based on Mix of Monolingual Recordings and Cross-Lingual Voice Conversion

Shengkui Zhao, Trung Hieu Nguyen, Hao Wang, Bin Ma

Whisper Activity Detection Using CNN-LSTM Based Attention Pooling Network Trained for a Speaker Identification Task

Abinay Reddy Naini, Malla Satyapriya, Prasanta Kumar Ghosh

Surfboard: Audio Feature Extraction for Modern Machine Learning

Raphael Lenain, Jack Weston, Abhishek Shivkumar, Emil Fristed

Adventitious Respiratory Classification Using Attentive Residual Neural Networks

Zijiang Yang, Shuo Liu, Meishu Song, Emilia Parada-Cabaleiro, Bjorn W. Schuller

Attention and Encoder-Decoder Based Models for Transforming Articulatory Movements at Different Speaking Rates

Abhayjeet Singh, Aravind Illa, Prasanta Kumar Ghosh

LungRN+NL: An Improved Adventitious Lung Sound Classification Using Non-Local Block ResNet Neural Network with Mixup Data Augmentation

Yi Ma, Xinzi Xu, Yongfu Li

Dysarthria Detection and Severity Assessment Using Rhythm-Based Metrics

Abner Hernandez, Eun Jung Yeo, Sunhee Kim, Minhwa Chung

Speech Rate Task-Specific Representation Learning from Acoustic-Articulatory Data

Renuka Mannem, Hima Jyothi R., Aravind Illa, Prasanta Kumar Ghosh

Discriminative Singular Spectrum Analysis for Bioacoustic Classification

Bernardo B. Gatto, Eulanda M. dos Santos, Juan G. Colonna, Naoya Sogi, Lincon S. Souza

Sequence-to-Sequence Articulatory Inversion Through Time Convolution of Sub-Band Frequency Signals

Abdolreza Sabzi Shahrebabaki, Sabato Marco Siniscalchi, Giampiero Salvi, Torbjørn Svendsen

Transfer Learning of Articulatory Information Through Phone Information

Abdolreza Sabzi Shahrebabaki, Negar Olfati, Sabato Marco Siniscalchi, Giampiero Salvi, Torbjørn Svendsen

Non-Intrusive Diagnostic Monitoring of Fullband Speech Quality

Sebastian Möller, Tobias Hübschen, Thilo Michael, Gabriel Mittag, Gerhard Schmidt

DNN No-Reference PSTN Speech Quality Prediction

Gabriel Mittag, Ross Cutler, Yasaman Hosseinkashi, Michael Revow, Sriram Srinivasan

An Open Source Implementation of ITU-T Recommendation P.808 with Validation

Babak Naderi, Ross Cutler

StoRIR: Stochastic Room Impulse Response Generation for Audio Data Augmentation

Piotr Masztalski, Mateusz Matuszewski, Karol Piaskowski, Michal Romaniuk

A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences

Pranay Manocha, Adam Finkelstein, Richard Zhang, Nicholas J. Bryan, Gautham J. Mysore

Improving Opus Low Bit Rate Quality with Neural Speech Synthesis

Jan Skoglund, Jean-Marc Valin

Hearing-Impaired Bio-Inspired Cochlear Models for Real-Time Auditory Applications

Arthur Van Den Broucke, Deepak Baby, Sarah Verhulst

Fundamental Frequency Model for Postfiltering at Low Bitrates in a Transform-Domain Speech and Audio Codec

Sneha Das, Tom Bäckström, Guillaume Fuchs

SCADA: Stochastic, Consistent and Adversarial Data Augmentation to Improve ASR

Gary Wang, Andrew Rosenberg, Zhehuai Chen, Yu Zhang, Bhuvana Ramabhadran

Utterance Invariant Training for Hybrid Two-Pass End-to-End Speech Recognition

Dhananjaya Gowda, Ankur Kumar, Kwangyoun Kim, Hejung Yang, Abhinav Garg

Phoneme-to-Grapheme Conversion Based Large-Scale Pre-Training for End-to-End Automatic Speech Recognition

Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka

Improved Noisy Student Training for Automatic Speech Recognition

Daniel S. Park, Yu Zhang, Ye Jia, Wei Han, Chung-Cheng Chiu

A New Training Pipeline for an Improved Neural Transducer

Albert Zeyer, André Merboldt, Ralf Schlüter, Hermann Ney

Efficient Minimum Word Error Rate Training of RNN-Transducer for End-to-End Speech Recognition

Jinxi Guo, Gautam Tiwari, Jasha Droppo, Maarten Van Segbroeck, Che-Wei Huang

Semi-Supervised Learning with Data Augmentation for End-to-End ASR

Felix Weninger, Franco Mana, Roberto Gemello, Jesus Andres-Ferrer, Puming Zhan

Serialized Output Training for End-to-End Overlapped Speech Recognition

Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka

Improved Training Strategies for End-to-End Speech Recognition in Digital Voice Assistants

Hitesh Tulsiani, Ashtosh Sapru, Harish Arsikere, Surabhi Punjabi, Sri Garimella

Semi-Supervised ASR by End-to-End Self-Training

Yang Chen, Weiran Wang, Chao Wang

Neural Speech Decoding for Amyotrophic Lateral Sclerosis

Debadatta Dash, Paul Ferrari, Angel Hernandez, Daragh Heitzman, Sara G. Austin

Speech Spectrogram Estimation from Intracranial Brain Activity Using a Quantization Approach

Miguel Angrick, Christian Herff, Garett Johnson, Jerry Shih, Dean Krusienski

Low Latency Auditory Attention Detection with Common Spatial Pattern Analysis of EEG Signals

Siqi Cai, Enze Su, Yonghao Song, Longhan Xie, Haizhou Li

The “Sound of Silence” in EEG — Cognitive Voice Activity Detection

Rini A. Sharon, Hema A. Murthy

Combining Audio and Brain Activity for Predicting Speech Quality

Ivan Halim Parmonangan, Hiroki Tanaka, Sakriani Sakti, Satoshi Nakamura

MLS: A Large-Scale Multilingual Dataset for Speech Research

Vineel Pratap, Qiantong Xu, Anuroop Sriram, Gabriel Synnaeve, Ronan Collobert

Multimodal Sign Language Recognition via Temporal Deformable Convolutional Sequence Learning

Katerina Papadimitriou, Gerasimos Potamianos

Improving Unsupervised Sparsespeech Acoustic Models with Categorical Reparameterization

Benjamin Milde, Chris Biemann

Neural Speech Completion

Kazuki Tsunematsu, Johanes Effendi, Sakriani Sakti, Satoshi Nakamura

Generative Adversarial Training Data Adaptation for Very Low-Resource Automatic Speech Recognition

Kohei Matsuura, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara

Unsupervised Subword Modeling Using Autoregressive Pretraining and Cross-Lingual Phone-Aware Modeling

Siyuan Feng, Odette Scharenborg

Ultrasound-Based Articulatory-to-Acoustic Mapping with WaveGlow Speech Synthesis

Tamás Gábor Csapó, Csaba Zainkó, László Tóth, Gábor Gosztolya, Alexandra Markó

Speaker Dependent Articulatory-to-Acoustic Mapping Using Real-Time MRI of the Vocal Tract

Tamás Gábor Csapó

Multimodal Speech Emotion Recognition Using Cross Attention with Aligned Audio and Text

Yoonhyung Lee, Seunghyun Yoon, Kyomin Jung

Unsupervised vs. Transfer Learning for Multimodal One-Shot Matching of Speech and Images

Leanne Nortje, Herman Kamper

Speaker-Conditional Chain Model for Speech Separation and Extraction

Jing Shi, Jiaming Xu, Yusuke Fujita, Shinji Watanabe, Bo Xu

Bidirectional LSTM Network with Ordered Neurons for Speech Enhancement

Xiaoqi Li, Yaxing Li, Yuanjie Dong, Shan Xu, Zhihui Zhang

Subband Kalman Filtering with DNN Estimated Parameters for Speech Enhancement

Hongjiang Yu, Wei-Ping Zhu, Benoit Champagne

A Deep Learning-Based Kalman Filter for Speech Enhancement

Sujan Kumar Roy, Aaron Nicolson, Kuldip K. Paliwal

Sub-Band Knowledge Distillation Framework for Speech Enhancement

Xiang Hao, Shixue Wen, Xiangdong Su, Yun Liu, Guanglai Gao

Speech Separation Based on Multi-Stage Elaborated Dual-Path Deep BiLSTM with Auxiliary Identity Loss

Ziqiang Shi, Rujie Liu, Jiqing Han

VoiceFilter-Lite: Streaming Targeted Voice Separation for On-Device Speech Recognition

Quan Wang, Ignacio Lopez Moreno, Mert Saglam, Kevin Wilson, Alan Chiao

Multi-Scale TCN: Exploring Better Temporal DNN Model for Causal Speech Enhancement

Lu Zhang, Mingjiang Wang

An NMF-HMM Speech Enhancement Method Based on Kullback-Leibler Divergence

Yang Xiang, Liming Shi, Jesper Lisby Højvang, Morten Højfeldt Rasmussen, Mads Græsbøll Christensen

Adversarial Latent Representation Learning for Speech Enhancement

Yuanhang Qiu, Ruili Wang

Unsupervised Audio Source Separation Using Generative Priors

Vivek Narayanaswamy, Jayaraman J. Thiagarajan, Rushil Anirudh, Andreas Spanias

Multi-Path RNN for Hierarchical Modeling of Long Sequential Data and its Application to Speaker Stream Separation

Keisuke Kinoshita, Thilo von Neumann, Marc Delcroix, Tomohiro Nakatani, Reinhold Haeb-Umbach

Conv-TasSAN: Separative Adversarial Network Based on Conv-TasNet

Chengyun Deng, Yi Zhang, Shiqian Ma, Yongtao Sha, Hui Song

Dual-Path Transformer Network: Direct Context-Aware Modeling for End-to-End Monaural Speech Separation

Jingjing Chen, Qirong Mao, Dong Liu

Asteroid: The PyTorch-Based Audio Source Separation Toolkit for Researchers

Manuel Pariente, Samuele Cornell, Joris Cosentino, Sunit Sivasankaran, Efthymios Tzinis

Learning Better Speech Representations by Worsening Interference

Jun Wang

On Synthesis for Supervised Monaural Speech Separation in Time Domain

Jingjing Chen, Qirong Mao, Dong Liu

Separating Varying Numbers of Sources with Auxiliary Autoencoding Loss

Yi Luo, Nima Mesgarani

FEARLESS STEPS Challenge (FS-2): Supervised Learning with Massive Naturalistic Apollo Data

Aditya Joglekar, John H.L. Hansen, Meena Chandra Shekar, Abhijeet Sangwan

“This is Houston. Say again, please”. The Behavox System for the Apollo-11 Fearless Steps Challenge (Phase II)

Arseniy Gorin, Daniil Kulko, Steven Grima, Alex Glasman

The DKU Speech Activity Detection and Speaker Identification Systems for Fearless Steps Challenge Phase-02

Qingjian Lin, Tingle Li, Ming Li