Interspeech 2021

999 papers

Advanced Semi-Blind Speaker Extraction and Tracking Implemented in Experimental Device with Revolving Dense Microphone Array

J. Čmejla, T. Kounovský, J. Janský, Jiri Malek, M. Rozkovec

On-Device Streaming Transformer-Based End-to-End Speech Recognition

Yoo Rhee Oh, Kiyoung Park

The LIUM Human Active Correction Platform for Speaker Diarization

Alexandre Flucha, Anthony Larcher, Ambuj Mehrish, Sylvain Meignier, Florian Plaut

ROXANNE Research Platform: Automate Criminal Investigations

Maël Fabien, Shantipriya Parida, Petr Motlicek, Dawei Zhu, Aravind Krishnan

Downsizing of Vocal-Tract Models to Line up Variations and Reduce Manufacturing Costs

Takayuki Arai

Beey: More Than a Speech-to-Text Editor

Lenka Weingartová, Veronika Volná, Ewa Balejová

Application for Detecting Depression, Parkinson’s Disease and Dysphonic Speech

Gábor Kiss, Dávid Sztahó, Miklós Gábriel Tulics

Investigating Feature Selection and Explainability for COVID-19 Diagnostics from Cough Sounds

Flavio Avila, Amir H. Poorjam, Deepak Mittal, Charles Dognin, Ananya Muguli

Contrastive Learning of Cough Descriptors for Automatic COVID-19 Preliminary Diagnosis

Swapnil Bhosale, Upasana Tiwari, Rupayan Chakraborty, Sunil Kumar Kopparapu

Cough-Based COVID-19 Detection with Contextual Attention Convolutional Neural Networks and Gender Information

Adria Mallol-Ragolta, Helena Cuesta, Emilia Gómez, Bjorn W. Schuller

COVID-19 Detection from Spectral Features on the DiCOVA Dataset

Kotra Venkata Sai Ritwik, Shareef Babu Kalluri, Deepu Vijayasenan

The DiCOVA 2021 Challenge — An Encoder-Decoder Approach for COVID-19 Recognition from Coughing Audio

Gauri Deshpande, Bjorn W. Schuller

Classification of COVID-19 from Cough Using Autoregressive Predictive Coding Pretraining and Spectral Data Augmentation

John Harvill, Yash R. Wani, Mark Hasegawa-Johnson, Narendra Ahuja, David Beiser

Diagnosis of COVID-19 Using Auditory Acoustic Cues

Rohan Kumar Das, Maulik Madhavi, Haizhou Li

Detecting COVID-19 from Audio Recording of Coughs Using Random Forests and Support Vector Machines

Isabella Södergren, Maryam Pahlavan Nodeh, Prakash Chandra Chhipa, Konstantina Nikolaidou, György Kovács

Recognising Covid-19 from Coughing Using Ensembles of SVMs and LSTMs with Handcrafted and Deep Audio Features

Vincent Karas, Bjorn W. Schuller

PANACEA Cough Sound-Based Diagnosis of COVID-19 for the DiCOVA 2021 Challenge

Madhu R. Kamble, Jose A. Gonzalez-Lopez, Teresa Grau, Juan M. Espín, Lorenzo Cascioli

DiCOVA Challenge: Dataset, Task, and Baseline System for COVID-19 Diagnosis Using Acoustics

Ananya Muguli, Lancelot Pinto, Nirmala R, Neeraj Sharma, Prashant Krishnan

SynthASR: Unlocking Synthetic Data for Speech Recognition

Amin Fazel, Wei Yang, Yulan Liu, Roberto Barra-Chicote, Yixiong Meng

Evaluating the Vulnerability of End-to-End Automatic Speech Recognition Models to Membership Inference Attacks

Muhammad A. Shah, Joseph Szurley, Markus Mueller, Athanasios Mouchtaris, Jasha Droppo

Continual Learning for Fake Audio Detection

Haoxin Ma, Jiangyan Yi, Jianhua Tao, Ye Bai, Zhengkun Tian

PATE-AAE: Incorporating Adversarial Autoencoder into Private Aggregation of Teacher Ensembles for Spoken Command Classification

Chao-Han Huck Yang, Sabato Marco Siniscalchi, Chin-Hui Lee

Privacy-Preserving Feature Extraction for Cloud-Based Wake Word Verification

Timm Koppelmann, Alexandru Nelus, Lea Schönherr, Dorothea Kolossa, Rainer Martin

Communication-Efficient Agnostic Federated Averaging

Jae Ro, Mingqing Chen, Rajiv Mathews, Mehryar Mohri, Ananda Theertha Suresh

Adjunct-Emeritus Distillation for Semi-Supervised Language Model Adaptation

Scott Novotney, Yile Gu, Ivan Bulyko

Configurable Privacy-Preserving Automatic Speech Recognition

Ranya Aloufi, Hamed Haddadi, David Boyle

Privacy-Preserving Voice Anti-Spoofing Using Secure Multi-Party Computation

Oubaïda Chouchane, Baptiste Brossier, Jorge Esteban Gamboa Gamboa, Thomas Lardy, Hemlata Tak

Many-to-Many Voice Conversion Based Feature Disentanglement Using Variational Autoencoder

Manh Luong, Viet Anh Tran

Adversarially Learning Disentangled Speech Representations for Robust Multi-Factor Voice Conversion

Jie Wang, Jingbei Li, Xintao Zhao, Zhiyong Wu, Shiyin Kang

An Exemplar Selection Algorithm for Native-Nonnative Voice Conversion

Christopher Liberatore, Ricardo Gutierrez-Osuna

S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations

Jheng-hao Lin, Yist Y. Lin, Chung-Ming Chien, Hung-yi Lee

Enriching Source Style Transfer in Recognition-Synthesis Based Non-Parallel Voice Conversion

Zhichao Wang, Xinyong Zhou, Fengyu Yang, Tao Li, Hongqiang Du

TVQVC: Transformer Based Vector Quantized Variational Autoencoder with CTC Loss for Voice Conversion

Ziyi Chen, Pengyuan Zhang

An Improved StarGAN for Emotional Voice Conversion: Enhancing Voice Quality and Data Augmentation

Xiangheng He, Junjie Chen, Georgios Rizos, Bjorn W. Schuller

Adversarial Voice Conversion Against Neural Spoofing Detectors

Yi-Yang Ding, Li-Juan Liu, YU HU, Zhen-Hua Ling

Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-Stage Sequence-to-Sequence Training

Kun Zhou, Berrak Sisman, Haizhou Li

Investigating Deep Neural Structures and their Interpretability in the Domain of Voice Conversion

Samuel J. Broughton, Md. Asif Jalal, Roger K. Moore

Speaker Transition Patterns in Three-Party Conversation: Evidence from English, Estonian and Swedish

Marcin Włodarczak, Emer Gilmartin

Enhancing Semantic Understanding with Self-Supervised Methods for Abstractive Dialogue Summarization

HyunJae Lee, Jaewoong Yun, Hyunjin Choi, Seongho Joe, Youngjune L. Gwon

Multimodal Speech Summarization Through Semantic Concept Learning

Shruti Palaskar, Ruslan Salakhutdinov, Alan W. Black, Florian Metze

Targeted Keyword Filtering for Accelerated Spoken Topic Identification

Jonathan Wintrode

A Noise Robust Method for Word-Level Pronunciation Assessment

Binghuai Lin, Liyuan Wang

Zero-Shot Joint Modeling of Multiple Spoken-Text-Style Conversion Tasks Using Switching Tokens

Mana Ihori, Naoki Makishima, Tomohiro Tanaka, Akihiko Takashima, Shota Orihashi

Discriminative Self-Training for Punctuation Prediction

Qian Chen, Wen Wang, Mengzhe Chen, Qinglin Zhang

Disfluency Detection with Unlabeled Data and Small BERT Models

Johann C. Rocholl, Vicky Zayats, Daniel D. Walker, Noah B. Murad, Aaron Schneider

SmallER: Scaling Neural Entity Resolution for Edge Devices

Ross McGowan, Jinru Su, Vince DiCocco, Thejaswi Muniyappa, Grant P. Strimel

Speaker-Conversation Factorial Designs for Diarization Error Analysis

Scott Seyfarth, Sundararajan Srinivasan, Katrin Kirchhoff

Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS

Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu

Phonetically Motivated Self-Supervised Speech Representation Learning

Xianghu Yue, Haizhou Li

slimIPL: Language-Model-Free Iterative Pseudo-Labeling

Tatiana Likhomanenko, Qiantong Xu, Jacob Kahn, Gabriel Synnaeve, Ronan Collobert

Semi-Supervision in ASR: Sequential MixMatch and Factorized TTS-Based Augmentation

Zhehuai Chen, Andrew Rosenberg, Yu Zhang, Heiga Zen, Mohammadreza Ghodsi

A Comparison of Supervised and Unsupervised Pre-Training of End-to-End Models

Ananya Misra, Dongseong Hwang, Zhouyuan Huo, Shefali Garg, Nikhil Siddhartha

Momentum Pseudo-Labeling for Semi-Supervised Speech Recognition

Yosuke Higuchi, Niko Moritz, Jonathan Le Roux, Takaaki Hori

Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training

Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu

On the Learning Dynamics of Semi-Supervised Training for ASR

Electra Wallington, Benji Kershenbaum, Ondrej Klejch, Peter Bell

wav2vec-C: A Self-Supervised Model for Speech Representation Learning

Samik Sadhu, Di He, Che-Wei Huang, Sri Harish Mallidi, Minhua Wu

Improving Streaming Transformer Based ASR Under a Framework of Self-Supervised Learning

Songjun Cao, Yueteng Kang, Yanzhe Fu, Xiaoshuo Xu, Sining Sun

Minimum-Norm Differential Beamforming for Linear Array with Directional Microphones

Weilong Huang, Jinwei Feng

Explaining Deep Learning Models for Speech Enhancement

Sunit Sivasankaran, Emmanuel Vincent, Dominique Fohr

Optimising Hearing Aid Fittings for Speech in Noise with a Differentiable Hearing Loss Model

Zehai Tu, Ning Ma, Jon Barker

Clarity-2021 Challenges: Machine Learning Challenges for Advancing Hearing Aid Processing

Simone Graetzer, Jon Barker, Trevor J. Cox, Michael Akeroyd, John F. Culling

A Deep Learning Method to Multi-Channel Active Noise Control

Hao Zhang, Deliang Wang

Cancellation of Local Competing Speaker with Near-Field Localization for Distributed ad-hoc Sensor Network

Pablo Pérez Zarazaga, Mariem Bouafif Mansali, Tom Bäckström, Zied Lachiri

Multiple Sound Source Localization Based on Interchannel Phase Differences in All Frequencies with Spectral Masks

Hyungchan Song, Jong Won Shin

Microphone Array Generalization for Multichannel Narrowband Deep Speech Enhancement

Siyuan Zhang, Xiaofei Li

Alpha-Stable Autoregressive Fast Multichannel Nonnegative Matrix Factorization for Joint Speech Enhancement and Dereverberation

Mathieu Fontaine, Kouhei Sekiguchi, Aditya Arie Nugraha, Yoshiaki Bando, Kazuyoshi Yoshii

LACOPE: Latency-Constrained Pitch Estimation for Speech Enhancement

Hendrik Schröter, Tobias Rosenkranz, Alberto N. Escalante-B, Andreas Maier

Investigating Speech Reconstruction for Laryngectomees for Silent Speech Interfaces

Beiming Cao, Nordine Sebkhi, Arpan Bhavsar, Omer T. Inan, Robin Samlan

RaSSpeR: Radar-Based Silent Speech Recognition

David Ferreira, Samuel Silva, Francisco Curado, António Teixeira

Silent versus Modal Multi-Speaker Speech Recognition from Ultrasound and Video

Manuel Sam Ribeiro, Aciel Eshky, Korin Richmond, Steve Renals

An Automatic, Simple Ultrasound Biofeedback Parameter for Distinguishing Accurate and Misarticulated Rhotic Syllables

Sarah R. Li, Colin T. Annand, Sarah Dugan, Sarah M. Schwab, Kathryn J. Eary

Remote Smartphone-Based Speech Collection: Acceptance and Barriers in Individuals with Major Depressive Disorder

Judith Dineley, Grace Lavelle, Daniel Leightley, Faith Matcham, Sara Siddi

An Attention Self-Supervised Contrastive Learning Based Three-Stage Model for Hand Shape Feature Representation in Cued Speech

Jianrong Wang, Nan Gu, Mei Yu, Xuewei Li, Qiang Fang

Image-Based Assessment of Jaw Parameters and Jaw Kinematics for Articulatory Simulation: Preliminary Results

Ajish K. Abraham, V. Sivaramakrishnan, N. Swapna, N. Manohar

A Comparative Study of Different EMG Features for Acoustics-to-EMG Mapping

Manthan Sharma, Navaneetha Gaddam, Tejas Umesh, Aditya Murthy, Prasanta Kumar Ghosh

Effect of Carrier Bandwidth on Understanding Mandarin Sentences in Simulated Electric-Acoustic Hearing

Feng Wang, Jing Chen, Fei Chen

Segment and Tone Production in Continuous Speech of Hearing and Hearing-Impaired Children

Shu-Chuan Tseng, Yi-Fen Liu

Acoustic Event Detection with Classifier Chains

Tatsuya Komatsu, Shinji Watanabe, Koichi Miyazaki, Tomoki Hayashi

Improving Weakly Supervised Sound Event Detection with Self-Supervised Auxiliary Tasks

Soham Deshmukh, Bhiksha Raj, Rita Singh

Variational Information Bottleneck for Effective Low-Resource Audio Classification

Shijing Si, Jianzong Wang, Huiming Sun, Jianhan Wu, Chuanyao Zhang

Optimizing Latency for Online Video Captioning Using Audio-Visual Transformers

Chiori Hori, Takaaki Hori, Jonathan Le Roux

An Evaluation of Data Augmentation Methods for Sound Scene Geotagging

Helen L. Bear, Veronica Morfi, Emmanouil Benetos

Shallow Convolution-Augmented Transformer with Differentiable Neural Computer for Low-Complexity Classification of Variable-Length Acoustic Scene

Soonshin Seo, Donghyun Lee, Ji-Hwan Kim

AST: Audio Spectrogram Transformer

Yuan Gong, Yu-An Chung, James Glass

Event Specific Attention for Polyphonic Sound Event Detection

Harshavardhan Sundar, Ming Sun, Chao Wang

Acoustic Scene Classification Using Kervolution-Based SubSpectralNet

Ritika Nandi, Shashank Shekhar, Manjunath Mulimani

An Effective Mutual Mean Teaching Based Domain Adaptation Method for Sound Event Detection

Xu Zheng, Yan Song, Li-Rong Dai, Ian McLoughlin, Lin Liu

SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification

Helin Wang, Yuexian Zou, Wenwu Wang

SpecMix : A Mixed Sample Data Augmentation Method for Training with Time-Frequency Domain Features

Gwantae Kim, David K. Han, Hanseok Ko

Models of Reaction Times in Auditory Lexical Decision: RTonset versus RToffset

Sophie Brand, Kimberley Mulder, Louis ten Bosch, Lou Boves

Time-to-Event Models for Analyzing Reaction Time Sequences

Louis ten Bosch, Lou Boves

Word Competition: An Entropy-Based Approach in the DIANA Model of Human Word Comprehension

Louis ten Bosch, Lou Boves

Extracting Different Levels of Speech Information from EEG Using an LSTM-Based Model

Mohammad Jalilpour Monesi, Bernd Accou, Tom Francart, Hugo Van hamme

Variation in Perceptual Sensitivity and Compensation for Coarticulation Across Adult and Child Naturally-Produced and TTS Voices

Aleese Block, Michelle Cohn, Georgia Zellou

Prosodic Disambiguation Using Chironomic Stylization of Intonation with Native and Non-Native Speakers

Xiao Xiao, Nicolas Audibert, Grégoire Locqueville, Christophe d'Alessandro, Barbara Kuhnert

ICSpk: Interpretable Complex Speaker Embedding Extractor from Raw Waveform

Junyi Peng, Xiaoyang Qu, Jianzong Wang, Rongzhi Gu, Jing Xiao

Multi-Task Neural Network for Robust Multiple Speaker Embedding Extraction

Weipeng He, Petr Motlicek, Jean-Marc Odobez

Speaker Embeddings by Modeling Channel-Wise Correlations

Themos Stafylakis, Johan Rohdin, Lukas Burget

Spine2Net: SpineNet with Res2Net and Time-Squeeze-and-Excitation Blocks for Speaker Recognition

Magdalena Rybicka, Jesus Villalba, Piotr Żelasko, Najim Dehak, Konrad Kowalczyk

Leveraging Speaker Attribute Information Using Multi Task Learning for Speaker Verification and Diarization

Chau Luu, Peter Bell, Steve Renals