Interspeech 2021

999 papers

Emotion Recognition from Speech Using wav2vec 2.0 Embeddings

Leonardo Pepino, Pablo Riera, Luciana Ferrer

Acted vs. Improvised: Domain Adaptation for Elicitation Approaches in Audio-Visual Emotion Recognition

Haoqi Li, Yelin Kim, Cheng-hao Kuo, Shrikanth S. Narayanan

Stochastic Process Regression for Cross-Cultural Speech Emotion Recognition

Mani Kumar T, Enrique Sanchez, Georgios Tzimiropoulos, Timo Giesbrecht, Michel Valstar

Multimodal Sentiment Analysis with Temporal Modality Attention

Fan Qian, Jiqing Han

Automatic Analysis of the Emotional Content of Speech in Daylong Child-Centered Recordings from a Neonatal Intensive Care Unit

Einari Vaaras, Sari Ahlqvist-Björkroth, Konstantinos Drossos, Okko Rasanen

Learning Fine-Grained Cross Modality Excitement for Speech Emotion Recognition

Hang Li, Wenbiao Ding, Zhongqin Wu, Zitao Liu

Temporal Context in Speech Emotion Recognition

Yangyang Xia, Li-Wei Chen, Alexander Rudnicky, Richard M. Stern

N-MTTL SI Model: Non-Intrusive Multi-Task Transfer Learning-Based Speech Intelligibility Prediction Model with Scenery Classification

Ľuboš Marcinek, Michael Stone, Rebecca Millman, Patrick Gaydecki

Fusion-Net: Time-Frequency Information Fusion Y-Network for Speech Enhancement

Santhan Kumar Reddy Nareddula, Subrahmanyam Gorthi, Rama Krishna Sai S. Gorthi

End-to-End Optimized Multi-Stage Vector Quantization of Spectral Envelopes for Speech and Audio Coding

Mohammad Hassan Vali, Tom Bäckström

Changes in Glottal Source Parameter Values with Light to Moderate Physical Load

Heather Weston, Laura L. Koenig, Susanne Fuchs

Learning Robust Speech Representation with an Articulatory-Regularized Variational Autoencoder

Marc-Antoine Georges, Laurent Girin, Jean-Luc Schwartz, Thomas Hueber

Importance of Parasagittal Sensor Information in Tongue Motion Capture Through a Diphonic Analysis

Salvador Medina, Sarah Taylor, Mark Tiede, Alexander Hauptmann, Iain Matthews

Effects of Time Pressure and Spontaneity on Phonotactic Innovations in German Dialogues

Petra Wagner, Sina Zarrieß, Joana Cholin

Comparison of the Finite Element Method, the Multimodal Method and the Transmission-Line Model for the Computation of Vocal Tract Transfer Functions

Rémi Blandin, Marc Arnela, Simon Félix, Jean-Baptiste Doc, Peter Birkholz

Towards the Prediction of the Vocal Tract Shape from the Sequence of Phonemes to be Articulated

Vinicius Ribeiro, Karyna Isaieva, Justine Leclere, Pierre-André Vuissoz, Yves Laprie

Adaptive Listening to Everyday Soundscapes

Mounya Elhilali

Learning Speech Models from Multi-Modal Data

Karen Livescu

ViSTAFAE: A Visual Speech-Training Aid with Feedback of Articulatory Efforts

Pramod H. Kachare, Prem C. Pandey, Vishal Mane, Hirak Dasgupta, K.S. Nataraj

Expressive Latvian Speech Synthesis for Dialog Systems

Dāvis Nicmanis, Askars Salimbajevs

Live Subtitling for BigBlueButton with Open-Source Software

Robert Geislinger, Benjamin Milde, Timo Baumann, Chris Biemann

Digital Einstein Experience: Fast Text-to-Speech for Conversational AI

Joanna Rownicka, Kilian Sprenkamp, Antonio Tripiana, Volodymyr Gromoglasov, Timo P. Kunz

The INGENIOUS Multilingual Operations App

Joan Codina-Filbà, Guillermo Cámbara, Alex Peiró-Lilja, Jens Grivolla, Roberto Carlini

Articulatory Data Recorder: A Framework for Real-Time Articulatory Data Recording

Alexander Wilbrandt, Simon Stone, Peter Birkholz

MoM: Minutes of Meeting Bot

Benjamin Milde, Tim Fischer, Steffen Remus, Chris Biemann

Modeling the Effect of Military Oxygen Masks on Speech Characteristics

Benjamin Elie, Jodie Gauvain, Jean-Luc Gauvain, Lori Lamel

Boosting of Contextual Information in ASR for Air-Traffic Call-Sign Recognition

Martin Kocour, Karel Veselý, Alexander Blatt, Juan Zuluaga Gomez, Igor Szőke

Contextual Semi-Supervised Learning: An Approach to Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systems

Juan Zuluaga-Gomez, Iuliia Nigmatulina, Amrutha Prasad, Petr Motlicek, Karel Veselý

Robust Command Recognition for Lithuanian Air Traffic Control Tower Utterances

Oliver Ohneiser, Seyyed Saeed Sarfjoo, Hartmut Helmke, Shruthi Shetty, Petr Motlicek

Detecting English Speech in the Air Traffic Control Voice Communication

Igor Szőke, Santosh Kesiraju, Ondřej Novotný, Martin Kocour, Karel Veselý

Towards an Accent-Robust Approach for ATC Communications Transcription

Nataly Jahchan, Florentin Barbier, Ariyanidevi Dharma Gita, Khaled Khelif, Estelle Delpech

Additive Phoneme-Aware Margin Softmax Loss for Language Recognition

Zheng Li, Yan Liu, Lin Li, Qingyang Hong

Language Recognition Based on Unsupervised Pretrained Models

Haibin YU, Jing Zhao, Song Yang, Zhongqin Wu, Yuting Nie

An End-to-End Dialect Identification System with Transfer Learning from a Multilingual Automatic Speech Recognition Model

Ding Wang, Shuaishuai Ye, Xinhui Hu, Sheng Li, Xinkang Xu

Dynamic Multi-Scale Convolution for Dialect Identification

Tianlong Kong, Shouyi Yin, Dawei Zhang, Wang Geng, Xin Wang

Language Recognition on Unknown Conditions: The LORIA-Inria-MULTISPEECH System for AP20-OLR Challenge

Raphaël Duroselle, Md. Sahidullah, Denis Jouvet, Irina Illina

Oriental Language Recognition (OLR) 2020: Summary and Analysis

Jing Li, Binling Wang, Yiming Zhi, Zheng Li, Lin Li

Adapting Long Context NLM for ASR Rescoring in Conversational Agents

Ashish Shenoy, Sravan Bodapati, Monica Sunkara, Srikanth Ronanki, Katrin Kirchhoff

Joint Retrieval-Extraction Training for Evidence-Aware Dialog Response Selection

Hongyin Luo, James Glass, Garima Lalwani, Yi Zhang, Shang-Wen Li

PhonemeBERT: Joint Language Modelling of Phoneme Sequence and ASR Transcript

Mukuntha Narayanan Sundararaman, Ayush Kumar, Jithendra Vepa

Human-to-Human Conversation Dataset for Learning Fine-Grained Turn-Taking Action

Kehan Chen, Zezhong Li, Suyang Dai, Wei Zhou, Haiqing Chen

Timing Generating Networks: Neural Network Based Precise Turn-Taking Timing Prediction in Multiparty Conversation

Shinya Fujie, Hayato Katayama, Jin Sakuma, Tetsunori Kobayashi

Causal Confusion Reduction for Robust Multi-Domain Dialogue Policy

Mahdin Rohmatillah, Jen-Tzung Chien

Injecting Descriptive Meta-Information into Pre-Trained Language Models with Hypernetworks

Wenying Duan, Xiaoxi He, Zimu Zhou, Hong Rao, Lothar Thiele

Contextualized Attention-Based Knowledge Transfer for Spoken Conversational Question Answering

Chenyu You, Nuo Chen, Yuexian Zou

Mixture of Orthogonal Sequences Made from Extended Time-Stretched Pulses Enables Measurement of Involuntary Voice Fundamental Frequency Response to Pitch Perturbation

Hideki Kawahara, Toshie Matsui, Kohei Yatabe, Ken-Ichi Sakakibara, Minoru Tsuzaki

Modeling Sensorimotor Adaptation in Speech Through Alterations to Forward and Inverse Models

Taijing Chen, Adam Lammert, Benjamin Parrell

Take a Breath: Respiratory Sounds Improve Recollection in Synthetic Speech

Mikey Elmers, Raphael Werner, Beeke Muhlack, Bernd Möbius, Jürgen Trouvain

Model-Based Exploration of Linking Between Vowel Articulatory Space and Acoustic Space

Anqi Xu, Daniel van Niekerk, Branislav Gerazov, Paul Konstantin Krug, Santitham Prom-on

Inhalations in Speech: Acoustic and Physiological Characteristics

Raphael Werner, Susanne Fuchs, Jürgen Trouvain, Bernd Möbius

Comparison Between Lumped-Mass Modeling and Flow Simulation of the Reed-Type Artificial Vocal Fold

Rafia Inaam, Tsukasa Yoshinaga, Takayuki Arai, Hiroshi Yokoyama, Akiyoshi Iida

Using Transposed Convolution for Articulatory-to-Acoustic Conversion from Real-Time MRI Data

Ryo Tanji, Hidefumi Ohmura, Kouichi Katsurada

Vocal-Tract Models to Visualize the Airstream of Human Breath and Droplets While Producing Speech

Takayuki Arai

A Simplified Model for the Vocal Tract of [s] with Inclined Incisors

Tsukasa Yoshinaga, Kohei Tada, Kazunori Nozaki, Akiyoshi Iida

A Prototypical Network Approach for Evaluating Generated Emotional Speech

Alice Baird, Silvan Mertes, Manuel Milling, Lukas Stappen, Thomas Wiest

Applying the Information Bottleneck Principle to Prosodic Representation Learning

Guangyan Zhang, Ying Qin, Daxin Tan, Tan Lee

Intra-Sentential Speaking Rate Control in Neural Text-To-Speech for Automatic Dubbing

Mayank Sharma, Yogesh Virkar, Marcello Federico, Roberto Barra-Chicote, Robert Enyedi

Fine-Grained Prosody Modeling in Neural Speech Synthesis Using ToBI Representation

Yuxiang Zou, Shichao Liu, Xiang Yin, Haopeng Lin, Chunfeng Wang

Phoneme Duration Modeling Using Speech Rhythm-Based Speaker Embeddings for Multi-Speaker Speech Synthesis

Kenichi Fujita, Atsushi Ando, Yusuke Ijima

Rich Prosody Diversity Modelling with Phone-Level Mixture Density Network

Chenpeng Du, Kai Yu

Improving Multi-Speaker TTS Prosody Variance with a Residual Encoder and Normalizing Flows

Iván Vallés-Pérez, Julian Roth, Grzegorz Beringer, Roberto Barra-Chicote, Jasha Droppo

Phrase Break Prediction with Bidirectional Encoder Representations in Japanese Text-to-Speech Synthesis

Kosuke Futamata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana

A Thousand Words are Worth More Than One Recording:Word-EmbeddingBased Speaker Change Detection

Or Haim Anidjar, Itshak Lapidot, Chen Hajaj, Amit Dvir

Online Streaming End-to-End Neural Diarization Handling Overlapping Speech and Flexible Numbers of Speakers

Yawen Xue, Shota Horiguchi, Yusuke Fujita, Yuki Takashima, Shinji Watanabe

End-To-End Speaker Segmentation for Overlap-Aware Resegmentation

Hervé Bredin, Antoine Laurent

Scenario-Dependent Speaker Diarization for DIHARD-III Challenge

Yu-Xuan Wang, Jun Du, Maokui He, Shu-Tong Niu, Lei Sun

Adapting Speaker Embeddings for Speaker Diarisation

Youngki Kwon, Jee-weon Jung, Hee-soo Heo, You Jin Kim, Bong-Jin Lee

Semi-Supervised Training with Pseudo-Labeling for End-To-End Neural Diarization

Yuki Takashima, Yusuke Fujita, Shota Horiguchi, Shinji Watanabe, Leibny Paola García Perera

Online Speaker Diarization Equipped with Discriminative Modeling and Guided Inference

Xucheng Wan, Kai Liu, Huan Zhou

Three-Class Overlapped Speech Detection Using a Convolutional Recurrent Neural Network

Jee-weon Jung, Hee-soo Heo, Youngki Kwon, Joon Son Chung, Bong-Jin Lee

End-to-End Neural Diarization: From Transformer to Conformer

Yi Chieh Liu, Eunjung Han, Chul Lee, Andreas Stolcke

Generalized Spatio-Temporal RNN Beamformer for Target Speech Separation

Yong Xu, Zhuohuang Zhang, Meng Yu, Shi-Xiong Zhang, Dong Yu

Implicit Filter-and-Sum Network for End-to-End Multi-Channel Speech Separation

Yi Luo, Nima Mesgarani

Investigation of Practical Aspects of Single Channel Speech Separation for ASR

Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka

Dual-Path Filter Network: Speaker-Aware Modeling for Speech Separation

Fan-Lin Wang, Yu-Huai Peng, Hung-Shin Lee, Hsin-Min Wang

Stabilizing Label Assignment for Speech Separation by Self-Supervised Pre-Training

Sung-Feng Huang, Shun-Po Chuang, Da-Rong Liu, Yi-Chen Chen, Gene-Ping Yang

Efficient and Stable Adversarial Learning Using Unpaired Data for Unsupervised Multichannel Speech Separation

Yu Nakagome, Masahito Togami, Tetsuji Ogawa, Tetsunori Kobayashi

End-to-End Speech Separation Using Orthogonal Representation in Complex and Real Time-Frequency Domain

Kai Wang, Hao Huang, Ying Hu, Zhihua Huang, Sheng Li

Crossfire Conditional Generative Adversarial Networks for Singing Voice Extraction

Weitao Yuan, Shengbei Wang, Xiangrui Li, Masashi Unoki, Wenwu Wang

Continuous Speech Separation Using Speaker Inventory for Long Recording

Cong Han, Yi Luo, Chenda Li, Tianyan Zhou, Keisuke Kinoshita

Group Delay Based Re-Weighted Sparse Recovery Algorithms for Robust and High-Resolution Source Separation in DOA Framework

Murtiza Ali, Ashwani Koul, Karan Nathwani

Ultra Fast Speech Separation Model with Teacher Student Learning

Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka

Audio-Visual Multi-Talker Speech Recognition in a Cocktail Party

Yifei Wu, Chenda Li, Song Yang, Zhongqin Wu, Yanmin Qian

End-to-End Audio-Visual Speech Recognition for Overlapping Speech

Richard Rose, Olivier Siohan, Anshuman Tripathi, Otavio Braga

LiRA: Learning Visual Speech Representations from Audio Through Self-Supervision

Pingchuan Ma, Rodrigo Mira, Stavros Petridis, Bjorn W. Schuller, Maja Pantic

Cascaded Multilingual Audio-Visual Learning from Videos

Andrew Rouditchenko, Angie Boggust, David Harwath, Samuel Thomas, Hilde Kuehne

Automatic Lip-Reading with Hierarchical Pyramidal Convolution and Self-Attention for Image Sequences with No Word Boundaries

Hang Chen, Jun Du, YU HU, Li-Rong Dai, Bao-Cai Yin

Evaluation of Audio-Visual Alignments in Visually Grounded Speech Models

Khazar Khorrami, Okko Rasanen

Attention-Based Keyword Localisation in Speech Using Visual Grounding

Kayode Olaleye, Herman Kamper

Cross-Modal Knowledge Distillation Method for Automatic Cued Speech Recognition

Jianrong Wang, Ziyue Tang, Xuewei Li, Mei Yu, Qiang Fang

A Fast Discrete Two-Step Learning Hashing for Scalable Cross-Modal Retrieval

Huan Zhao, Kaili Ma

Talk, Don’t Write: A Study of Direct Speech-Based Image Retrieval

Ramon Sanabria, Austin Waters, Jason Baldridge

Direct Multimodal Few-Shot Learning of Speech and Images

Leanne Nortje, Herman Kamper

CLAC: A Speech Corpus of Healthy English Speakers

R’mani Haulcy, James Glass

Source and Vocal Tract Cues for Speech-Based Classification of Patients with Parkinson’s Disease and Healthy Subjects

Tanuka Bhattacharjee, Jhansi Mallela, Yamini Belur, Nalini Atchayaram, Ravi Yadav

Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimization

Disong Wang, Liqun Deng, Yu Ting Yeung, Xiao Chen, Xunying Liu

Uncertainty-Aware COVID-19 Detection from Imbalanced Sound Data

Tong Xia, Jing Han, Lorena Qendro, Ting Dang, Cecilia Mascolo

Parental Spoken Scaffolding and Narrative Skills in Crowd-Sourced Storytelling Samples of Young Children

Zhengjun Yue, Jon Barker, Heidi Christensen, Cristina McKean, Elaine Ashton

Identifying Cognitive Impairment Using Sentence Representation Vectors

Bahman Mirheidari, Yilin Pan, Daniel Blackburn, Ronan O’Malley, Heidi Christensen

Assessing Posterior-Based Mispronunciation Detection on Field-Collected Recordings from Child Speech Therapy Sessions

Adam Hair, Guanlong Zhao, Beena Ahmed, Kirrie J. Ballard, Ricardo Gutierrez-Osuna