Interspeech 2023

1,141 papers

Leveraging Semantic Information for Efficient Self-Supervised Emotion Recognition with Audio-Textual Distilled Models

Danilo de Oliveira, Navin Raj Prabhu, Timo Gerkmann

Exploring Downstream Transfer of Self-Supervised Features for Speech Emotion Recognition

Yuanbo Fang, Xiaofen Xing, Xiangmin Xu, Weibin Zhang

Laughter in task-based settings: whom we talk to affects how, when, and how often we laugh

Catarina Branco, Isabel Trancoso, Paulo Infante, Khiet P. Truong

Node-weighted Graph Convolutional Network for Depression Detection in Transcribed Clinical Interviews

Sergio Burdisso, Esau Villatoro-tello, Srikanth Madikeri, Petr Motlicek

Utility-Preserving Privacy-Enabled Speech Embeddings for Emotion Detection

Chandrashekhar Lavania, Sanjiv Das, Xin Huang, Kyu J. Han

Integrating Emotion Recognition with Speech Recognition and Speaker Diarisation for Conversations

Wen Wu, Chao Zhang, Philip C. Woodland

Pre-Finetuning for Few-Shot Emotional Speech Recognition

Maximillian Chen, Zhou Yu

EmotionNAS: Two-stream Neural Architecture Search for Speech Emotion Recognition

Haiyang Sun, Zheng Lian, Bin Liu, Ying Li, Jianhua Tao

The co-use of laughter and head gestures across speech styles

Bogdan Ludusan, Marin Schröer, Martina Rossi, Petra Wagner

MetricAug: A Distortion Metric-Lead Augmentation Strategy for Training Noise-Robust Speech Emotion Recognizer

Ya-Tse Wu, Chi-Chun Lee

A Context-Constrained Sentence Modeling for Deception Detection in Real Interrogation

Ya-Tse Wu, Yuan-Ting Chang, Shao-Hao Lu, Jing-Yi Chuang, Chi-Chun Lee

End-to-End Neural Speaker Diarization with Absolute Speaker Loss

Chao Wang, Jie Li, Xiang Fang, Jian Kang, Yongxiang Li

The SpeeD--ZevoTech submission at DISPLACE 2023

Gabriel Pirlogeanu, Dan Oneata, Alexandru-Lucian Georgescu, Horia Cucu

Lexical Speaker Error Correction: Leveraging Language Models for Speaker Diarization Error Correction

Rohit Paturi, Sundararajan Srinivasan, Xiang Li

The DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environments

Shikha Baghel, Shreyas Ramoji, Sidharth, Ranjana H, Prachi Singh

Robust Self Supervised Speech Embeddings for Child-Adult Classification in Interactions involving Children with Autism

Rimita Lahiri, Tiantian Feng, Rajat Hebbar, Catherine Lord, So Hyun Kim

Attention-based Encoder-Decoder Network for End-to-End Neural Speaker Diarization with Target Speaker Attractor

Zhengyang Chen, Bing Han, Shuai Wang, Yanmin Qian

Vowel Normalisation in Latent Space for Sociolinguistics

James Burridge

Sociodemographic and Attitudinal Effects on Dialect Speakers’ Articulation of the Standard Language: Evidence from German-Speaking Switzerland

Carina Steiner, Dieter Studer-Joho, Corinne Lanthemann, Andrin Büchler, Adrian Leemann

Speech Entrainment in Chinese Story-Style Talk Shows: The Interaction Between Gender and Role

Yanting Sun, Hongwei Ding

Aberystwyth English Pre-aspiration in Apparent Time

Míša Michaela Hejná, Adèle Jatteau

Mixture Encoder for Joint Speech Separation and Recognition

Simon Berger, Peter Vieting, Christoph Boeddeker, Ralf Schlüter, Reinhold Haeb-Umbach

Directional Speech Recognition for Speaker Disambiguation and Cross-talk Suppression

Ju Lin, Niko Moritz, Ruiming Xie, Kaustubh Kalgaonkar, Christian Fuegen

Weakly-Supervised Speech Pre-training: A Case Study on Target Speech Recognition

Wangyou Zhang, Yanmin Qian

Overlap Aware Continuous Speech Separation without Permutation Invariant Training

Linfeng Yu, Wangyou Zhang, Chenda Li, Yanmin Qian

GPU-accelerated Guided Source Separation for Meeting Transcription

Desh Raj, Daniel Povey, Sanjeev Khudanpur

Speaker Diarization for ASR Output with T-vectors: A Sequence Classification Approach

Midia Yousefi, Naoyuki Kanda, Dongmei Wang, Zhuo Chen, Xiaofei Wang

Joint compensation of multi-talker noise and reverberation for speech enhancement with cochlear implants using one or more microphones

Clément Gaultier, Tobias Goehring

Improving Label Assignments Learning by Dynamic Sample Dropout Combined with Layer-wise Optimization in Speech Separation

Chenyang Gao, Yue Gu, Ivan Marsic

BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASR

Yuhao Liang, Fan Yu, Yangze Li, Pengcheng Guo, Shiliang Zhang

Unsupervised Adaptation with Quality-Aware Masking to Improve Target-Speaker Voice Activity Detection for Speaker Diarization

Shutong Niu, Jun Du, Maokui He, Chin-Hui Lee, Baoxiang Li

Multi-Stream Extension of Variational Bayesian HMM Clustering (MS-VBx) for Combined End-to-End and Vector Clustering-based Diarization

Marc Delcroix, Naohiro Tawara, Mireia Diez, Federico Landini, Anna Silnova

Time-domain Transformer-based Audiovisual Speaker Separation

Vahid Ahmadi Kalkhorani, Anurag Kumar, Ke Tan, Buye Xu, Deliang Wang

Unified Modeling of Multi-Talker Overlapped Speech Recognition and Diarization with a Sidecar Separator

Lingwei Meng, Jiawen Kang, Mingyu Cui, Haibin Wu, Xixin Wu

TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition

Hakan Erdogan, Scott Wisdom, Xuankai Chang, Zalán Borsos, Marco Tagliasacchi

Cascaded encoders for fine-tuning ASR models on overlapped speech

Richard Rose, Oscar Chang, Olivier Siohan

SEF-Net: Speaker Embedding Free Target Speaker Extraction Network

Bang Zeng, Suo Hongbin, Yulong Wan, Ming Li

Enhancing Visual Question Answering via Deconstructing Questions and Explicating Answers

Feilong Chen, Minglun Han, Jing Shi, Shuang Xu, Bo Xu

Multi-Scale Attention for Audio Question Answering

Guangyao Li, Yixin XU, Di Hu

Question-Context Alignment and Answer-Context Dependencies for Effective Answer Sentence Selection

Minh Van Nguyen, Kishan KC, Toan Nguyen, Thien Huu Nguyen, Ankit Chadha

On Monotonic Aggregation for Open-domain QA

Sang-eun Han, Yeonseok Jeong, Seung-won Hwang, Kyungjae Lee

Composing Spoken Hints for Follow-on Question Suggestion in Voice Assistants

Pedro Faustini, Besnik Fetahu, Giuseppe Castellucci, Anjie Fang, Oleg Rokhlenko

Prompt Guided Copy Mechanism for Conversational Question Answering

Yong Zhang, Zhitao Li, Jianzong Wang, Yiming Gao, Ning Cheng

JAMFN: Joint Attention Multi-Scale Fusion Network for Depression Detection

Li Zhou, Zhenyu Liu, Zixuan Shangguan, Xiaoyan Yuan, Yutong Li

Visually grounded few-shot word acquisition with fewer shots

Leanne Nortje, Benjamin Van Niekerk, Herman Kamper

A Novel Interpretable and Generalizable Re-synchronization Model for Cued Speech based on a Multi-Cuer Corpus

Lufei Gao, Shan Huang, Li Liu

Whistle-to-text: Automatic recognition of the Silbo Gomero whistled language

Agata Jakubiak

Improving the Gap in Visual Speech Recognition Between Normal and Silent Speech Based on Metric Learning

Sara Kashiwagi, Keitaro Tanaka, Qi Feng, Shigeo Morishima

BeAts: Bengali Speech Acts Recognition using Multimodal Attention Fusion

Ahana Deb, Sayan Nag, Ayan Mahapatra, Soumitri Chattopadhyay, Aritra Marik

eCat: An End-to-End Model for Multi-Speaker TTS & Many-to-Many Fine-Grained Prosody Transfer

Ammar Abbas, Sri Karlapati, Bastian Schnell, Penny Karanasou, Marcel Granero Moya

Beyond Style: Synthesizing Speech with Pragmatic Functions

Harm Lameris, Joakim Gustafson, Eva Szekely

Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesis

Weiqin Li, Shun Lei, Qiaochu Huang, Yixuan Zhou, Zhiyong Wu

A Generative Framework for Conversational Laughter: Its 'Language Model' and Laughter Sound Synthesis

Hiroki Mori, Shunya Kimura

SGEM: Test-Time Adaptation for Automatic Speech Recognition via Sequential-Level Generalized Entropy Minimization

Changhun Kim, Joonhyung Park, Hajin Shim, Eunho Yang

Don’t Stop Self-Supervision: Accent Adaptation of Speech Representations via Residual Adapters

Anshu Bhatia, Sanchit Sinha, Saket Dingliwal, Karthik Gopalakrishnan, Sravan Bodapati

Modular Domain Adaptation for Conformer-Based Streaming ASR

Qiujia Li, Bo Li, Dongseong Hwang, Tara Sainath, Pedro M. Mengibar

Cross-Lingual Cross-Age Adaptation for Low-Resource Elderly Speech Emotion Recognition

Samuel Cahyawijaya, Holy Lovenia, Willy Chung, Rita Frieske, Zihan Liu

Text Only Domain Adaptation with Phoneme Guided Data Splicing for End-to-End Speech Recognition

Wei Wang, Xun Gong, Hang Shao, Dongning Yang, Yanmin Qian

Factorised Speaker-environment Adaptive Training of Conformer Speech Recognition Systems

Jiajun Deng, Guinan Li, Xurong Xie, Zengrui Jin, Mingyu Cui

Compressed MoE ASR Model Based on Knowledge Distillation and Quantization

Yuping Yuan, Zhao You, Shulin Feng, Dan Su, Yanchun Liang

Lossless 4-bit Quantization of Architecture Compressed Conformer ASR Systems on the 300-hr Switchboard Corpus

Zhaoqing Li, Tianzi Wang, Jiajun Deng, Junhao Xu, Shoukang Hu

Mixture-of-Expert Conformer for Streaming Multilingual ASR

Ke Hu, Bo Li, Tara Sainath, Yu Zhang, Françoise Beaufays

Language-specific Boundary Learning for Improving Mandarin-English Code-switching Speech Recognition

Zhiyun Fan, Linhao Dong, Chen Shen, Zhenlin Liang, Jun Zhang

Neural Model Reprogramming with Similarity Based Mapping for Low-Resource Spoken Command Recognition

Hao Yen, Pin-Jui Ku, Chao-Han Huck Yang, Hu Hu, Sabato Marco Siniscalchi

4D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoders

Yui Sudo, Shakeel Muhammad, Brian Yan, Jiatong Shi, Shinji Watanabe

Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition

Zhisheng Zheng, Ziyang Ma, Yu Wang, Xie Chen

Multilingual Contextual Adapters To Improve Custom Word Recognition In Low-resource Languages

Devang Kulshreshtha, Saket Dingliwal, Brady Houston, Sravan Bodapati

Word-level Confidence Estimation for CTC Models

Burin Naowarat, Thananchai Kongthaworn, Ekapol Chuangsuwanich

Quantization-aware and Tensor-compressed Training of Transformers for Natural Language Understanding

Zi Yang, Samridhi Choudhary, Siegfried Kunzmann, Zheng Zhang

Exploration on HuBERT with Multiple Resolution

Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino

CoMFLP: Correlation Measure Based Fast Search on ASR Layer Pruning

Wei Liu, Zhiyuan Peng, Tan Lee

miniStreamer: Enhancing Small Conformer with Chunked-Context Masking for Streaming ASR Applications on the Edge

Haris Gulzar, Monikka Roslianna Busto, Takeharu Eda, Katsutoshi Itoyama, Kazuhiro Nakadai

SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge

Jiaxu Zhu, Changhe Song, Zhiyong Wu, Helen Meng

N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Space

Rao Ma, Mark J. F. Gales, Kate M. Knill, Mengjie Qian

Towards continually learning new languages

Quan Pham, Jan Niehues, Alex Waibel

Two Stage Contextual Word Filtering for Context Bias in Unified Streaming and Non-streaming Transducer

Zhanheng Yang, Sining Sun, Xiong Wang, Yike Zhang, Long Ma

Combining Multilingual Resources and Models to Develop State-of-the-Art E2E ASR for Swedish

Lukas Mateju, Jan Nouza, Petr Cerva, Jindrich Zdansky, Frantisek Kynych

Accurate and Reliable Confidence Estimation Based on Non-Autoregressive End-to-End Speech Recognition System

Xian Shi, Haoneng Luo, Zhifu Gao, Shiliang Zhang, Zhijie Yan

ASR for Low Resource and Multilingual Noisy Code-Mixed Speech

Tushar Verma, Atul Shree, Ashutosh Modi

Modeling Dependent Structure for Utterances in ASR Evaluation

Zhe Liu, Fuchun Peng

A Model for Every User and Budget: Label-Free and Personalized Mixed-Precision Quantization

Edward Fish, Umberto Michieli, Mete Ozay

A Method of Audio-Visual Person Verification by Mining Connections between Time Series

Peiwen Sun, Shanshan Zhang, Zishan Liu, Yougen Yuan, Taotao Zhang

Powerset multi-class cross entropy loss for neural speaker diarization

Alexis Plaquet, Hervé Bredin

Exploring the English Accent-independent Features for Speech Emotion Recognition using Filter and Wrapper-based Methods for Feature Selection

Nowshin Tabassum, Tasfia Tabassum, Fardin Saad, Tahiya Sultana Safa, Hasan Mahmud

Range-Based Equal Error Rate for Spoof Localization

Lin Zhang, Xin Wang, Erica Cooper, Nicholas Evans, Junichi Yamagishi

Describing the phonetics in the underlying speech attributes for deep and interpretable speaker recognition

Imen Ben-Amor, Jean-Francois Bonastre, Benjamin O'Brien, Pierre-Michel Bousquet

Build a SRE Challenge System: Lessons from VoxSRC 2022 and CNSRC 2022

Zhengyang Chen, Bing Han, Xu Xiang, Houjun Huang, Bei Liu

Self-Distillation into Self-Attention Heads for Improving Transformer-based End-to-End Neural Speaker Diarization

Ye-Rin Jeoung, Jeong-Hwan Choi, Ju-Seok Seong, Jehyun Kyung, Joon-Hyuk Chang

Robust Training for Speaker Verification against Noisy Labels

Zhihua Fang, Liang He, Hanhan Ma, Xiaochen Guo, Lin Li

Group GMM-ResNet for Detection of Synthetic Speech Attacks

Zhenchun Lei, Yan Wen, Yingen Yang, Changhong Liu, Minglei Ma

P-vectors: A Parallel-coupled TDNN/Transformer Network for Speaker Verification

Xiyuan Wang, Fangyuan Wang, Bo Xu, Liang Xu, Jing Xiao

On the robustness of wav2vec 2.0 based speaker recognition systems

Sergey Novoselov, Galina Lavrentyeva, Anastasia Avdeeva, Vladimir Volokhov, Nikita Khmelev

Instance-based Temporal Normalization for Speaker Verification

Thanathai Lertpetchpun, Ekapol Chuangsuwanich

Improving training datasets for resource-constrained speaker recognition neural networks

Pierre-Michel Bousquet, Mickael Rouvier

Phase perturbation improves channel robustness for speech spoofing countermeasures

Yongyi Zang, You Zhang, Zhiyao Duan

Improving End-to-End Neural Diarization Using Conversational Summary Representations

Samuel J. Broughton, Lahiru Samarakoon

Target Active Speaker Detection with Audio-visual Cues

Yidi Jiang, Ruijie Tao, Zexu Pan, Haizhou Li

Mutual Information-based Embedding Decoupling for Generalizable Speaker Verification

Jianchen Li, Jiqing Han, Shiwen Deng, Tieran Zheng, Yongjun He

Fooling Speaker Identification Systems with Adversarial Background Music

Chu-Xiao Zuo, Jia-Yi Leng, Wu-jun Li

TO-Rawnet: Improving RawNet with TCN and Orthogonal Regularization for Fake Audio Detection

Chenglong Wang, Jiangyan Yi, Jianhua Tao, Chu Yuan Zhang, SHUAI ZHANG