Interspeech 2020

1,035 papers

End-to-End ASR with Adaptive Span Self-Attention

Xuankai Chang, Aswin Shanmugam Subramanian, Pengcheng Guo, Shinji Watanabe, Yuya Fujita

Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability

Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei

Leveraging Unlabeled Speech for Sequence Discriminative Training of Acoustic Models

Ashtosh Sapru, Sri Garimella

Semi-Supervised End-to-End ASR via Teacher-Student Learning with Conditional Posterior Distribution

Zi-qiang Zhang, Yan Song, Jian-shu Zhang, Ian McLoughlin, Li-Rong Dai

SpeedySpeech: Efficient Neural Speech Synthesis

Jan Vainer, Ondřej Dušek

Neural Text-to-Speech with a Modeling-by-Generation Excitation Vocoder

Eunwoo Song, Min-Jae Hwang, Ryuichi Yamamoto, Jin-Seob Kim, Ohsung Kwon

Bunched LPCNet: Vocoder for Low-Cost Neural Text-To-Speech Systems

Ravichander Vipperla, Sangjun Park, Kihyun Choo, Samin Ishtiaq, Kyoungbo Min

Reverberation Modeling for Source-Filter-Based Neural Vocoder

Yang Ai, Xin Wang, Junichi Yamagishi, Zhen-Hua Ling

An Efficient Subband Linear Prediction for LPCNet-Based Neural Synthesis

Yang Cui, Xi Wang, Lei He, Frank K. Soong

StrawNet: Self-Training WaveNet for TTS in Low-Data Regimes

Manish Sharma, Tom Kenter, Rob Clark

Audio Dequantization for High Fidelity Audio Generation in Flow-Based Neural Vocoder

Hyun-Wook Yoon, Sang-Hoon Lee, Hyeong-Rae Noh, Seong-Whan Lee

A Cyclical Post-Filtering Approach to Mismatch Refinement of Neural Vocoder for Text-to-Speech Systems

YI-CHIAO WU, Patrick Lumban Tobing, Kazuki Yasuhara, Noriyuki Matsunaga, Yamato Ohtani

Quasi-Periodic Parallel WaveGAN Vocoder: A Non-Autoregressive Pitch-Dependent Dilated Convolution Model for Parametric Speech Generation

YI-CHIAO WU, Tomoki Hayashi, Takuma Okamoto, Hisashi Kawai, Tomoki Toda

Vocoder-Based Speech Synthesis from Silent Videos

Daniel Michelsanti, Olga Slizovskaia, Gloria Haro, Emilia Gómez, Zheng-Hua Tan

Successes, Challenges and Opportunities for Speech Technology in Conversational Agents

Shehzad Mevawalla

Caption Alignment for Low Resource Audio-Visual Data

Vighnesh Reddy Konda, Mayur Warialani, Rakesh Prasanth Achari, Varad Bhatnagar, Jayaprakash Akula

Lip Graph Assisted Audio-Visual Speech Recognition Using Bidirectional Synchronous Fusion

Hong Liu, Zhan Chen, Bing Yang

Speech-Image Semantic Alignment Does Not Depend on Any Prior Classification Tasks

Masood S. Mortazavi

Resource-Adaptive Deep Learning for Visual Speech Recognition

Alexandros Koumparoulis, Gerasimos Potamianos, Samuel Thomas, Edmilson da Silva Morais

Should we Hard-Code the Recurrence Concept or Learn it Instead ? Exploring the Transformer Architecture for Audio-Visual Speech Recognition

George Sterpu, Christian Saam, Naomi Harte

TMT: A Transformer-Based Modal Translator for Improving Multimodal Sequence Representations in Audio Visual Scene-Aware Dialog

Wubo Li, Dongwei Jiang, Wei Zou, Xiangang Li

Audio-Visual Multi-Channel Recognition of Overlapped Speech

Jianwei Yu, Bo Wu, Rongzhi Gu, Shi-Xiong Zhang, Lianwu Chen

Fusion Architectures for Word-Based Audiovisual Speech Recognition

Michael Wand, Jürgen Schmidhuber

Seeing Voices and Hearing Voices: Learning Discriminative Embeddings Using Cross-Modal Self-Supervision

Soo-Whan Chung, Hong-Goo Kang, Joon Son Chung

FaceFilter: Audio-Visual Speech Separation Using Still Images

Soo-Whan Chung, Soyeon Choe, Joon Son Chung, Hong-Goo Kang

The JD AI Speaker Verification System for the FFSVC 2020 Challenge

Ying Tong, Wei Xue, Shanluo Huang, Lu Fan, Chao Zhang

NPU Speaker Verification System for INTERSPEECH 2020 Far-Field Speaker Verification Challenge

Li Zhang, Jian Wu, Lei Xie

STC-Innovation Speaker Recognition Systems for Far-Field Speaker Verification Challenge 2020

Aleksei Gusev, Vladimir Volokhov, Alisa Vinogradova, Tseren Andzhukaev, Andrey Shulipa

Deep Embedding Learning for Text-Dependent Speaker Verification

Peng Zhang, Peng Hu, Xueliang Zhang

The INTERSPEECH 2020 Far-Field Speaker Verification Challenge

Xiaoyi Qin, Ming Li, Hui Bu, Wei Rao, Rohan Kumar Das

The Phonetic Bases of Vocal Expressed Emotion: Natural versus Acted

Hira Dhamyal, Shahan Ali Memon, Bhiksha Raj, Rita Singh

GAN-Based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumanati

Hierarchical Multi-Grained Generative Model for Expressive Speech Synthesis

Yukiya Hono, Kazuna Tsuboi, Kei Sawada, Kei Hashimoto, Keiichiro Oura

Exploiting Deep Sentential Context for Expressive End-to-End Speech Synthesis

Fengyu Yang, Shan Yang, Qinghua Wu, Yujun Wang, Lei Xie

Simultaneous Conversion of Speaker Identity and Emotion Based on Multiple-Domain Adaptive RBM

Takuya Kishida, Shin Tsukamoto, Toru Nakashika

Learning Syllable-Level Discrete Prosodic Representation for Expressive Speech Generation

Guangyan Zhang, Ying Qin, Tan Lee

Controlling the Strength of Emotions in Speech-Like Emotional Sound Generated by WaveNet

Kento Matsumoto, Sunao Hara, Masanobu Abe

Converting Anyone’s Emotion: Towards Speaker-Independent Emotional Voice Conversion

Kun Zhou, Berrak Sisman, Mingyang Zhang, Haizhou Li

Principal Style Components: Expressive Style Control and Cross-Speaker Transfer in Neural TTS

Alexander Sorin, Slava Shechtman, Ron Hoory

Nonparallel Emotional Speech Conversion Using VAE-GAN

Yuexin Cao, Zhengchen Liu, Minchuan Chen, Jun Ma, Shaojun Wang

Laughter Synthesis: Combining Seq2seq Modeling with Transfer Learning

Noé Tits, Kevin El Haddad, Thierry Dutoit

Non-Parallel Emotion Conversion Using a Deep-Generative Hybrid Network and an Adversarial Pair Discriminator

Ravi Shankar, Jacob Sager, Archana Venkataraman

Multi-Speaker Emotion Conversion via Latent Variable Regularization and a Chained Encoder-Decoder-Predictor Network

Ravi Shankar, Hsi-Wei Hsieh, Nicolas Charon, Archana Venkataraman

Rescore in a Flash: Compact, Cache Efficient Hashing Data Structures for n-Gram Language Models

Grant P. Strimel, Ariya Rastrow, Gautam Tiwari, Adrien Piérard, Jon Webb

Listen Attentively, and Spell Once: Whole Sentence Generation via a Non-Autoregressive Architecture for Low-Latency Speech Recognition

Ye Bai, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Zhengqi Wen

Scaling Up Online Speech Recognition Using ConvNets

Vineel Pratap, Qiantong Xu, Jacob Kahn, Gilad Avidov, Tatiana Likhomanenko

Streaming On-Device End-to-End ASR System for Privacy-Sensitive Voice-Typing

Abhinav Garg, Gowtham P. Vadisetti, Dhananjaya Gowda, Sichen Jin, Aditya Jayasimha

Quantization Aware Training with Absolute-Cosine Regularization for Automatic Speech Recognition

Hieu Duy Nguyen, Anastasios Alexandridis, Athanasios Mouchtaris

Iterative Compression of End-to-End ASR Model Using AutoML

Abhinav Mehrotra, Łukasz Dudziak, Jinsu Yeo, Young-Yoon Lee, Ravichander Vipperla

MatchboxNet: 1D Time-Channel Separable Convolutional Neural Network Architecture for Speech Commands Recognition

Somshubra Majumdar, Boris Ginsburg

Hybrid Transformer/CTC Networks for Hardware Efficient Voice Triggering

Saurabh Adya, Vineet Garg, Siddharth Sigtia, Pramod Simha, Chandra Dhir

Accurate Detection of Wake Word Start and End Using a CNN

Christin Jose, Yuriy Mishchenko, Thibaud Sénéchal, Anish Shah, Alex Escott

GEV Beamforming Supported by DOA-Based Masks Generated on Pairs of Microphones

François Grondin, Jean-Samuel Lauzon, Jonathan Vincent, François Michaud

Meta Multi-Task Learning for Speech Emotion Recognition

Ruichu Cai, Kaibin Guo, Boyan Xu, Xiaoyan Yang, Zhenjie Zhang

A Lightweight Model Based on Separable Convolution for Speech Emotion Recognition

Ying Zhong, Ying Hu, Hao Huang, Wushour Silamu

Generalized Minimal Distortion Principle for Blind Source Separation

Robin Scheibler

Gated Recurrent Fusion of Spatial and Spectral Features for Multi-Channel Speech Separation with Deep Embedding Representations

Cunhang Fan, Jianhua Tao, Bin Liu, Jiangyan Yi, Zhengqi Wen

The Method of Random Directions Optimization for Stereo Audio Source Separation

Oleg Golokolenko, Gerald Schuller

Atsuo Hiroe

Microphone Array Post-Filter for Target Speech Enhancement Without a Prior Information of Point Interferers

Guanjun Li, Shan Liang, Shuai Nie, Wenju Liu, Zhanlei Yang

Multi-Stream Attention-Based BLSTM with Feature Segmentation for Speech Emotion Recognition

Yuya Chiba, Takashi Nose, Akinori Ito

Efficient Low-Latency Speech Enhancement with Mobile Audio Streaming Networks

Michal Romaniuk, Piotr Masztalski, Karol Piaskowski, Mateusz Matuszewski

Real Time Speech Enhancement in the Waveform Domain

Alexandre Defossez, Gabriel Synnaeve, Yossi Adi

Improved Speech Enhancement Using a Time-Domain GAN with Mask Learning

Ju Lin, Sufeng Niu, Adriaan J. van Wijngaarden, Jerome L. McClendon, Melissa C. Smith

Real-Time Single-Channel Deep Neural Network-Based Speech Enhancement on Edge Devices

Nikhil Shankar, Gautam Shreedhar Bhat, Issa M.S. Panahi

Deep Speech Inpainting of Time-Frequency Masks

Mikolaj Kegler, Pierre Beckmann, Milos Cernak

Self-Supervised Adversarial Multi-Task Learning for Vocoder-Based Monaural Speech Enhancement

Zhihao Du, Ming Lei, Jiqing Han, Shiliang Zhang

On Loss Functions and Recurrency Training for GAN-Based Speech Enhancement Systems

Zhuohuang Zhang, Chengyun Deng, Yi Shen, Donald S. Williamson, Yongtao Sha

Noisy-Reverberant Speech Enhancement Using DenseUNet with Time-Frequency Attention

Yan Zhao, Deliang Wang

Learning Speaker Embedding from Text-to-Speech

Jaejin Cho, Piotr Żelasko, Jesus Villalba, Shinji Watanabe, Najim Dehak

Neural Discriminant Analysis for Deep Speaker Embedding

Lantian Li, Dong Wang, Thomas Fang Zheng

Deep Speaker Embedding with Long Short Term Centroid Learning for Text-Independent Speaker Verification

Junyi Peng, Rongzhi Gu, Yuexian Zou

Cosine-Distance Virtual Adversarial Training for Semi-Supervised Speaker-Discriminative Acoustic Embeddings

Florian L. Kreyssig, Philip C. Woodland

Compact Speaker Embedding: lrx-Vector

Munir Georges, Jonathan Huang, Tobias Bocklet

Intra-Class Variation Reduction of Speaker Representation in Disentanglement Framework

Yoohwan Kwon, Soo-Whan Chung, Hong-Goo Kang

Speaker Representation Learning Using Global Context Guided Channel and Time-Frequency Transformations

Wei Xia, John H.L. Hansen

A Comparative Re-Assessment of Feature Extractors for Deep Speaker Embeddings

Xuechen Liu, Md. Sahidullah, Tomi Kinnunen

How Does Label Noise Affect the Quality of Speaker Embeddings?

Minh Pham, Zeqian Li, Jacob Whitehill

Wav2Spk: A Simple DNN Architecture for Learning Speaker Embeddings from Waveforms

Weiwei Lin, Man-Wai Mak

Hider-Finder-Combiner: An Adversarial Architecture for General Speech Signal Modification

Jacob J. Webber, Olivier Perrotin, Simon King

Investigating Effective Additional Contextual Factors in DNN-Based Spontaneous Speech Synthesis

Yuki Yamashita, Tomoki Koriyama, Yuki Saito, Shinnosuke Takamichi, Yusuke Ijima

Learning Joint Articulatory-Acoustic Representations with Normalizing Flows

Pramit Saha, Sidney Fels

Semi-Supervised Learning for Multi-Speaker Text-to-Speech Synthesis Using Discrete Speech Representation

Tao Tu, Yuan-Jui Chen, Alexander H. Liu, Hung-yi Lee

Incremental Text to Speech for Neural Sequence-to-Sequence Models Using Reinforcement Learning

Devang S. Ram Mohan, Raphael Lenain, Lorenzo Foglianti, Tian Huey Teh, Marlene Staib

Enhancing Monotonicity for Robust Autoregressive Transformer TTS

Xiangyu Liang, Zhiyong Wu, Runnan Li, Yanqing Liu, Sheng Zhao

Speaker-Independent Mel-Cepstrum Estimation from Articulator Movements Using D-Vector Input

Kouichi Katsurada, Korin Richmond

Towards Universal Text-to-Speech

Jingzhou Yang, Lei He

Conditional Spoken Digit Generation with StyleGAN

Kasperi Palkama, Lauri Juvela, Alexander Ilin

Unsupervised Learning for Sequence-to-Sequence Text-to-Speech for Low-Resource Languages

Haitong Zhang, Yue Lin

Detection of Voicing and Place of Articulation of Fricatives with Deep Learning in a Virtual Speech and Language Therapy Tutor

Ivo Anjos, Maxine Eskenazi, Nuno Marques, Margarida Grilo, Isabel Guimarães

Effects of Communication Channels and Actor’s Gender on Emotion Identification by Native Mandarin Speakers

Yi Lin, Hongwei Ding

Towards a Comprehensive Assessment of Speech Intelligibility for Pathological Speech

W. Xue, V. Mendoza Ramos, W. Harmsen, Catia Cucchiarini, R.W.N.M. van Hout

Automatic Prediction of Confidence Level from Children’s Oral Reading Recordings

Kamini Sabu, Preeti Rao

Speaker Discrimination in Humans and Machines: Effects of Speaking Style Variability

Amber Afshan, Jody Kreiman, Abeer Alwan

Gaming Corpus for Studying Social Screams

Hiroki Mori, Yuki Kikuchi

Very Short-Term Conflict Intensity Estimation Using Fisher Vectors

Gábor Gosztolya

Predicting Collaborative Task Performance Using Graph Interlocutor Acoustic Network in Small Group Interaction

Shun-Chang Zhong, Bo-Hao Su, Wei Huang, Yi-Ching Liu, Chi-Chun Lee

Towards Silent Paralinguistics: Deriving Speaking Mode and Speaker ID from Electromyographic Signals

Lorenz Diener, Shahin Amiriparian, Catarina Botelho, Kevin Scheck, Dennis Küster

All-in-One Transformer: Unifying Speech Recognition, Audio Tagging, and Event Detection

Niko Moritz, Gordon Wichern, Takaaki Hori, Jonathan Le Roux

Detecting and Counting Overlapping Speakers in Distant Speech Scenarios

Samuele Cornell, Maurizio Omologo, Stefano Squartini, Emmanuel Vincent