Interspeech 2021

999 papers

Language and Speaker-Independent Feature Transformation for End-to-End Multilingual Speech Recognition

Tomoaki Hayakawa, Chee Siang Leow, Akio Kobayashi, Takehito Utsuro, Hiromitsu Nishizaki

Unsupervised Cross-Lingual Representation Learning for Speech Recognition

Alexis CONNEAU, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli

Efficient Weight Factorization for Multilingual Speech Recognition

Ngoc-Quan Pham, Tuan-Nam Nguyen, Sebastian Stüker, Alex Waibel

Bootstrap an End-to-End ASR System by Multilingual Training, Transfer Learning, Text-to-Text Mapping and Synthetic Audio

Manuel Giollo, Deniz Gunceler, Yulan Liu, Daniel Willett

Audio Retrieval with Natural Language Queries

Andreea-Maria Oncescu, A. Sophia Koepke, João F. Henriques, Zeynep Akata, Samuel Albanie

Non-Intrusive Speech Quality Assessment with Transfer Learning and Subject-Specific Scaling

Natalia Nessler, Milos Cernak, Paolo Prandoni, Pablo Mainar

Audiovisual Transfer Learning for Audio Tagging and Sound Event Detection

Wim Boes, Hugo Van hamme

ORCA-SLANG: An Automatic Multi-Stage Semi-Supervised Deep Learning Framework for Large-Scale Killer Whale Call Type Identification

Christian Bergler, Manuel Schmitt, Andreas Maier, Helena Symonds, Paul Spong

Extending the Fullband E-Model Towards Background Noise, Bursty Packet Loss, and Conversational Degradations

Thilo Michael, Gabriel Mittag, Andreas Bütow, Sebastian Möller

It’s Not What You Said, it’s How You Said it: Discriminative Perception of Speech as a Multichannel Communication System

Sarenne Wallbridge, Peter Bell, Catherine Lai

Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-Based Multimodal Fusion

Baptiste Pouthier, Laurent Pilati, Leela K. Gudupudi, Charles Bouveyron, Frederic Precioso

Lost in Interpreting: Speech Translation from Source or Interpreter?

Dominik Macháček, Matúš Žilinec, Ondřej Bojar

Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translation

Ha Nguyen, Yannick Estève, Laurent Besacier

Effective Phase Encoding for End-To-End Speaker Verification

Junyi Peng, Xiaoyang Qu, Rongzhi Gu, Jianzong Wang, Jing Xiao

Log-Likelihood-Ratio Cost Function as Objective Loss for Speaker Verification Systems

Victoria Mingote, Antonio Miguel, Alfonso Ortega, Eduardo Lleida

Graph Attention Networks for Anti-Spoofing

Hemlata Tak, Jee-weon Jung, Jose Patino, Massimiliano Todisco, Nicholas Evans

Reformulating DOVER-Lap Label Mapping as a Graph Partitioning Problem

Desh Raj, Sanjeev Khudanpur

Audio Segmentation Based Conversational Silence Detection for Contact Center Calls

Krishnachaitanya Gogineni, Tarun Reddy Yadama, Jithendra Vepa

Addressing Compliance in Call Centers with Entity Extraction

Sai Guruju, Jithendra Vepa

ThemePro 2.0: Showcasing the Role of Thematic Progression in Engaging Human-Computer Interaction

Mónica Domínguez, Juan Soler-Company, Leo Wanner

Expressive Robot Performance Based on Facial Motion Capture

Jonas Beskow, Charlie Caper, Johan Ehrenfors, Nils Hagberg, Anne Jansen

Autonomous Robot for Measuring Room Impulse Responses

Stefan Fragner, Tobias Topar, Maximilian Giller, Lukas Pfeifenberger, Franz Pernkopf

Live TV Subtitling Through Respeaking

Aleš Pražák, Zdeněk Loose, Josef V. Psutka, Vlasta Radová, Josef Psutka

Multi-Speaker Emotional Text-to-Speech Synthesizer

Sungjae Cho, Soo-Young Lee

The SJTU System for Short-Duration Speaker Verification Challenge 2021

Bing Han, Zhengyang Chen, Zhikai Zhou, Yanmin Qian

The Sogou System for Short-Duration Speaker Verification Challenge 2021

Jie Yan, Shengyu Yao, Yiqian Pan, Wei Chen

Investigation of IMU&Elevoc Submission for the Short-Duration Speaker Verification Challenge 2021

Peng Zhang, Peng Hu, Xueliang Zhang

Our Learned Lessons from Cross-Lingual Speaker Verification: The CRMI-DKU System Description for the Short-Duration Speaker Verification Challenge 2021

Xiaoyi Qin, Chao Wang, Yong Ma, Min Liu, Shilei Zhang

Team02 Text-Independent Speaker Verification System for SdSV Challenge 2021

Woo Hyun Kang, Nam Soo Kim

SdSVC Challenge 2021: Tips and Tricks to Boost the Short-Duration Speaker Verification System Performance

Aleksei Gusev, Alisa Vinogradova, Sergey Novoselov, Sergei Astapov

Integrating Frequency Translational Invariance in TDNNs and Frequency Positional Information in 2D ResNets to Enhance Speaker Verification

Jenthe Thienpondt, Brecht Desplanques, Kris Demuynck

The ID R&D System Description for Short-Duration Speaker Verification Challenge 2021

Alexander Alenin, Anton Okhotnikov, Rostislav Makarov, Nikita Torgashov, Ilya Shigabeev

Effects of Feature Scaling and Fusion on Sign Language Translation

Tejaswini Ananthanarayana, Lipisha Chaudhary, Ifeoma Nwogu

Optimally Encoding Inductive Biases into the Transformer Improves End-to-End Speech Translation

Piyush Vyas, Anastasia Kuznetsova, Donald S. Williamson

Lexical Modeling of ASR Errors for Robust Speech Translation

Giuseppe Martucci, Mauro Cettolo, Matteo Negri, Marco Turchi

Towards Simultaneous Machine Interpretation

Alejandro Pérez-González-de-Martos, Javier Iranzo-Sánchez, Adrià Giménez Pastor, Javier Jorge, Joan-Albert Silvestre-Cerdà

ASR Posterior-Based Loss for Multi-Task End-to-End Speech Translation

Yuka Ko, Katsuhito Sudoh, Sakriani Sakti, Satoshi Nakamura

End-to-End Speech Translation via Cross-Modal Progressive Training

Rong Ye, Mingxuan Wang, Lei Li

Transcribing Paralinguistic Acoustic Cues to Target Language Text in Transformer-Based Speech-to-Text Translation

Hirotaka Tokuyama, Sakriani Sakti, Katsuhito Sudoh, Satoshi Nakamura

Weakly-Supervised Speech-to-Text Mapping with Visually Connected Non-Parallel Speech-Text Data Using Cyclic Partially-Aligned Transformer

Johanes Effendi, Sakriani Sakti, Satoshi Nakamura

AlloST: Low-Resource Speech Translation Without Source Transcription

Yao-Fei Cheng, Hung-Shin Lee, Hsin-Min Wang

CoVoST 2 and Massively Multilingual Speech Translation

Changhan Wang, Anne Wu, Jiatao Gu, Juan Pino

Large-Scale Self- and Semi-Supervised Learning for Speech Translation

Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli

Subtitle Translation as Markup Translation

Colin Cherry, Naveen Arivazhagan, Dirk Padfield, Maxim Krikun

SpecRec: An Alternative Solution for Improving End-to-End Speech-to-Text Translation via Spectrogram Reconstruction

Junkun Chen, Mingbo Ma, Renjie Zheng, Liang Huang

High-Fidelity Parallel WaveGAN with Multi-Band Harmonic-Plus-Noise Model

Min-Jae Hwang, Ryuichi Yamamoto, Eunwoo Song, Jae-Min Kim

Basis-MelGAN: Efficient Neural Vocoder Based on Audio Decomposition

Zhengxi Liu, Yanmin Qian

High-Fidelity and Low-Latency Universal Neural Vocoder Based on Multiband WaveRNN with Data-Driven Linear Prediction for Discrete Waveform Modeling

Patrick Lumban Tobing, Tomoki Toda

Continuous Wavelet Vocoder-Based Decomposition of Parametric Speech Waveform Synthesis

Mohammed Salah Al-Radhi, Tamás Gábor Csapó, Csaba Zainkó, Géza Németh

UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation

Won Jang, Dan Lim, Jaesam Yoon, Bongwan Kim, Juntae Kim

GANSpeech: Adversarial Training for High-Fidelity Multi-Speaker Speech Synthesis

Jinhyeok Yang, Jae-Sung Bae, Taejun Bak, Young-Ik Kim, Hoon-Young Cho

Fre-GAN: Adversarial Frequency-Consistent Audio Synthesis

Ji-Hoon Kim, Sang-Hoon Lee, Ji-Hyun Lee, Seong-Whan Lee

Harmonic WaveGAN: GAN-Based Speech Waveform Generation Model with Harmonic Structure Discriminator

Kazuki Mizuta, Tomoki Koriyama, Hiroshi Saruwatari

Unified Source-Filter GAN: Unified Source-Filter Network Based On Factorization of Quasi-Periodic Parallel WaveGAN

Reo Yoneyama, YI-CHIAO WU, Tomoki Toda

Glow-WaveGAN: Learning Speech Representations from GAN-Based Variational Auto-Encoder for High Fidelity Flow-Based Speech Synthesis

Jian Cong, Shan Yang, Lei Xie, Dan Su

GAN Vocoder: Multi-Resolution Discriminator Is All You Need

Jaeseong You, Dalhyun Kim, Gyuhyeon Nam, Geumbyeol Hwang, Gyeongsu Chae

Cramér-Rao Lower Bound for DOA Estimation with an Array of Directional Microphones in Reverberant Environments

Weiguang Chen, Cheng Xue, Xionghu Zhong

On the Design of Deep Priors for Unsupervised Audio Restoration

Vivek Sivaraman Narayanaswamy, Jayaraman J. Thiagarajan, Andreas Spanias

Far-Field Speaker Localization and Adaptive GLMB Tracking

Shoufeng Lin, Zhaojie Luo

Feature Fusion by Attention Networks for Robust DOA Estimation

Rongliang Liu, Nengheng Zheng, Xi Chen

Assessment of von Mises-Bernoulli Deep Neural Network in Sound Source Localization

Katsutoshi Itoyama, Yoshiya Morimoto, Shungo Masaki, Ryosuke Kojima, Kenji Nishida

CNN-Based Processing of Acoustic and Radio Frequency Signals for Speaker Localization from MAVs

Andrea Toma, Daniele Salvati, Carlo Drioli, Gian Luca Foresti

MetricNet: Towards Improved Modeling For Non-Intrusive Speech Quality Assessment

Meng Yu, Chunlei Zhang, Yong Xu, Shi-Xiong Zhang, Dong Yu

Reliable Intensity Vector Selection for Multi-Source Direction-of-Arrival Estimation Using a Single Acoustic Vector Sensor

Jianhua Geng, Sifan Wang, Juan Li, Jingwei Li, Xin Lou

Subjective Evaluation of Noise Suppression Algorithms in Crowdsourcing

Babak Naderi, Ross Cutler

NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasets

Gabriel Mittag, Babak Naderi, Assmaa Chehadi, Sebastian Möller

Sound Source Localization with Majorization Minimization

Masahito Togami, Robin Scheibler

PILOT: Introducing Transformers for Probabilistic Sound Event Localization

Christopher Schymura, Benedikt Bönninghoff, Tsubasa Ochiai, Marc Delcroix, Keisuke Kinoshita

Difference in Perceived Speech Signal Quality Assessment Among Monolingual and Bilingual Teenage Students

Przemyslaw Falkowski-Gilski

Flexi-Transducer: Optimizing Latency, Accuracy and Compute for Multi-Domain On-Device Scenarios

Jay Mahadeokar, Yangyang Shi, Yuan Shangguan, Chunyang Wu, Alex Xiao

Transformer-Based ASR Incorporating Time-Reduction Layer and Fine-Tuning with Self-Knowledge Distillation

Md. Akmal Haidar, Chao Xing, Mehdi Rezagholizadeh

Advanced Long-Context End-to-End Speech Recognition Using Context-Expanded Transformers

Takaaki Hori, Niko Moritz, Chiori Hori, Jonathan Le Roux

A Comparative Study on Neural Architectures and Training Methods for Japanese Speech Recognition

Shigeki Karita, Yotaro Kubo, Michiel Adriaan Unico Bacchiani, Llion Jones

End to End Transformer-Based Contextual Speech Recognition Based on Pointer Network

Binghuai Lin, Liyuan Wang

Online Compressive Transformer for End-to-End Speech Recognition

Chi-Hang Leong, Yu-Han Huang, Jen-Tzung Chien

SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts

Zhao You, Shulin Feng, Dan Su, Dong Yu

Deformable TDNN with Adaptive Receptive Fields for Speech Recognition

Keyu An, Yi Zhang, Zhijian Ou

On the Limit of English Conversational Speech Recognition

Zoltán Tüske, George Saon, Brian Kingsbury

A Deliberation-Based Joint Acoustic and Text Decoder

Sepand Mavandadi, Tara N. Sainath, Ke Hu, Zelin Wu

Librispeech Transducer Model with Internal Language Model Prior Correction

Albert Zeyer, André Merboldt, Wilfried Michel, Ralf Schlüter, Hermann Ney

Domain-Aware Self-Attention for Multi-Domain Neural Machine Translation

Shiqi Zhang, Yan Liu, Deyi Xiong, Pei Zhang, Boxing Chen

Dynamic Encoder Transducer: A Flexible Solution for Trading Off Accuracy for Latency

Yangyang Shi, Varun Nagaraja, Chunyang Wu, Jay Mahadeokar, Duc Le

Correcting Automated and Manual Speech Transcription Errors Using Warped Language Models

Mahdi Namazifar, John Malik, Li Erran Li, Gokhan Tur, Dilek Hakkani Tur

A Discriminative Entity-Aware Language Model for Virtual Assistants

Mandana Saebi, Ernest Pusateri, Aaksha Meghawat, Christophe Van Gysel

Improving Customization of Neural Transducers by Mitigating Acoustic Mismatch of Synthesized Audio

Gakuto Kurata, George Saon, Brian Kingsbury, David Haws, Zoltán Tüske

Class-Based Neural Network Language Model for Second-Pass Rescoring in ASR

Lingfeng Dai, Qi Liu, Kai Yu

BART Based Semantic Correction for Mandarin Automatic Speech Recognition System

Yun Zhao, Xuerui Yang, Jinchao Wang, Yongyu Gao, Chao Yan

Token-Level Supervised Contrastive Learning for Punctuation Restoration

Qiushi Huang, Tom Ko, H. Lilian Tang, Xubo Liu, Bo Wu

Contextual Density Ratio for Language Model Biasing of Sequence to Sequence ASR Systems

Jesus Andres-Ferrer, Dario Albesano, Puming Zhan, Paul Vozila

Lookup-Table Recurrent Language Models for Long Tail Speech Recognition

W. Ronny Huang, Tara N. Sainath, Cal Peyser, Shankar Kumar, David Rybach

Revisiting Parity of Human vs. Machine Conversational Speech Transcription

Courtney Mansfield, Sara Ng, Gina-Anne Levow, Richard A. Wright, Mari Ostendorf

Phonetically Induced Subwords for End-to-End Speech Recognition

Vasileios Papadourakis, Markus Müller, Jing Liu, Athanasios Mouchtaris, Maurizio Omologo

Incorporating External POS Tagger for Punctuation Restoration

Ning Shi, Wei Wang, Boxin Wang, Jinfeng Li, Xiangyu Liu

A Light-Weight Contextual Spelling Correction Model for Customizing Transducer-Based Speech Recognition Systems

Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li

Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding

Suyoun Kim, Abhinav Arora, Duc Le, Ching-Feng Yeh, Christian Fuegen

Analysis of Eye Gaze Reasons and Gaze Aversions During Three-Party Conversations

Carlos Toshinori Ishi, Taiken Shintani

Investigating the Interplay Between Affective, Phonatory and Motoric Subsystems in Autism Spectrum Disorder Using a Multimodal Dialogue Agent

Hardik Kothare, Vikram Ramanarayanan, Oliver Roesler, Michael Neumann, Jackson Liscombe

Detecting Alzheimer’s Disease Using Interactional and Acoustic Features from Spontaneous Speech

Shamila Nasreen, Julian Hough, Matthew Purver

Lexical Entrainment and Intra-Speaker Variability in Cooperative Dialogues

Alla Menshikova, Daniil Kocharov, Tatiana Kachkovskaia

Effects of Voice Type and Task on L2 Learners’ Awareness of Pronunciation Errors

Alif Silpachai, Ivana Rehman, Taylor Anne Barriuso, John Levis, Evgeny Chukharev-Hudilainen