Lei Xie

Hearing More with Less: Multi-Modal Retrieval-and-Selection Augmented Conversational LLM-Based ASR AAAI 2026 KALL-E: Autoregressive Speech Synthesis with Next-Distribution Prediction AAAI 2026 Learning Effective Sign Features without Text for Gloss-free Sign Language Translation CVPR 2026 LLM-ForcedAligner: A Non-Autoregressive and Accurate LLM-Based Forced Aligner for Multilingual and Long-Form Speech ACL 2026 SignPR: A Progressive Vector-Quantized Diffusion Framework for Sign Language Production CVPR 2026 WenetSpeech-Yue: A Large-Scale Cantonese Speech Corpus with Multi-dimensional Annotation AAAI 2026 AISHELL-5: The First Open-Source In-Car Multi-Channel Multi-Speaker Speech Dataset for Automatic Speech Diarization and Recognition Interspeech 2025 CabinSep: IR-Augmented Mask-Based MVDR for Real-Time In-car Speech Separation with Distributed Heterogeneous Arrays Interspeech 2025 Contextualized Automatic Speech Recognition with Dynamic Vocabulary Prediction and Activation Interspeech 2025 Delayed-KD: Delayed Knowledge Distillation based CTC for Low-Latency Streaming ASR Interspeech 2025 Drop the Beat! Freestyler for Accompaniment Conditioned Rapping Voice Generation AAAI 2025 EASY: Emotion-aware Speaker Anonymization via Factorized Distillation Interspeech 2025 Enhancing Autonomous Driving Systems with On-Board Deployed Large Language Models RSS 2025 FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching Interspeech 2025 Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM ICML 2025 GenSE: Generative Speech Enhancement via Language Models using Hierarchical Modeling ICLR 2025 Leveraging LLM and Self-Supervised Training Models for Speech Recognition in Chinese Dialects: A Comparative Analysis Interspeech 2025 LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement ACL 2025 MM-MovieDubber: Towards Multi-Modal Learning for Multi-Modal Movie Dubbing Interspeech 2025 MobileMamba: Lightweight Multi-Receptive Visual Mamba Network CVPR 2025 PVTNL: Prompting Vision Transformers with Natural Language for Generalizable Person Re-identification EMNLP 2025 Selective Invocation for Multilingual ASR: A Cost-effective Approach Adapting to Speech Recognition Difficulty Interspeech 2025 StableVC: Style Controllable Zero-Shot Voice Conversion with Conditional Flow Matching AAAI 2025 Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling ACL 2025 Towards Robust Overlapping Speech Detection: A Speaker-Aware Progressive Approach Using WavLM Interspeech 2025 U-SAM: An Audio Language Model for Unified Speech, Audio, and Music Understanding Interspeech 2025 Weakly Supervised Data Refinement and Flexible Sequence Compression for Efficient Thai LLM-based ASR Interspeech 2025 A Diffusion-Based Framework for Multi-Class Anomaly Detection AAAI 2024 AS-70: A Mandarin stuttered speech dataset for automatic speech recognition and stuttering event detection Interspeech 2024 A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition Interspeech 2024 BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation Interspeech 2024 D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models NeurIPS 2024 DualVC 3: Leveraging Language Model Generated Pseudo Context for End-to-end Low Latency Streaming Voice Conversion Interspeech 2024 FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter Interspeech 2024 MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection NeurIPS 2024 RaD-Net 2: A causal two-stage repairing and denoising speech enhancement network with knowledge distillation and complex axial self-attention Interspeech 2024 SCDNet: Self-supervised Learning Feature based Speaker Change Detection Interspeech 2024 SEQ-former: A context-enhanced and efficient automatic speech recognition framework Interspeech 2024 SignGraph: A Sign Sequence is Worth Graphs of Nodes CVPR 2024 Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation Interspeech 2024 Streaming Decoder-Only Automatic Speech Recognition with Discrete Speech Units: A Pilot Study Interspeech 2024 StreamVoice: Streamable Context-Aware Language Modeling for Real-time Zero-Shot Voice Conversion ACL 2024 Text-aware and Context-aware Expressive Audiobook Speech Synthesis Interspeech 2024 Towards Expressive Zero-Shot Speech Synthesis with Hierarchical Prosody Modeling Interspeech 2024 Towards Rehearsal-Free Multilingual ASR: A LoRA-based Case Study on Whisper Interspeech 2024 Vec-Tok-VC+: Residual-enhanced Robust Zero-shot Voice Conversion with Progressive Constraints in a Dual-mode Training Strategy Interspeech 2024 WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmark Interspeech 2024 Adaptive Contextual Biasing for Transducer Based Streaming Speech Recognition Interspeech 2023 BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASR Interspeech 2023 Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Network Interspeech 2023 Contrastive Learning for Sign Language Recognition and Translation IJCAI 2023 DCCRN-KWS: An Audio Bias Based Model for Noise Robust Small-Footprint Keyword Spotting Interspeech 2023 DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding Interspeech 2023 PromptStyle: Controllable Style Transfer for Text-to-Speech with Natural Language Descriptions Interspeech 2023 Pseudo-Siamese Network based Timbre-reserved Black-box Adversarial Attack in Speaker Identification Interspeech 2023 StyleS2ST: Zero-shot Style Transfer for Direct Speech-to-speech Translation Interspeech 2023 The NPU-MSXF Speech-to-Speech Translation System for IWSLT 2023 Speech-to-Speech Translation Task ACL 2023 TranUSR: Phoneme-to-word Transcoder Based Unified Speech Representation Learning for Cross-lingual Speech Recognition Interspeech 2023 Two Stage Contextual Word Filtering for Context Bias in Unified Streaming and Non-streaming Transducer Interspeech 2023 UniSyn: An End-to-End Unified Model for Text-to-Speech and Singing Voice Synthesis AAAI 2023 VISinger2: High-Fidelity End-to-End Singing Voice Synthesis Enhanced by Digital Signal Processing Synthesizer Interspeech 2023 A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetings Interspeech 2022 A Transformer-Based Object Detector with Coarse-Fine Crossing Representations NeurIPS 2022 Backend Ensemble for Speaker Verification and Spoofing Countermeasure Interspeech 2022 CaTT-KWS: A Multi-stage Customized Keyword Spotting Framework based on Cascaded Transducer-Transformer Interspeech 2022 Cross-speaker Emotion Transfer Based On Prosody Compensation for End-to-End Speech Synthesis Interspeech 2022 Glow-WaveGAN 2: High-quality Zero-shot Text-to-speech Synthesis and Any-to-any Voice Conversion Interspeech 2022 Learn2Sing 2.0: Diffusion and Mutual Information-Based Target Speaker SVS by Learning from Singing Teacher Interspeech 2022 Learning Noise-independent Speech Representation for High-quality Voice Conversion for Noisy Target Speakers Interspeech 2022 Leveraging Acoustic Contextual Representation by Audio-textual Cross-modal Learning for Conversational ASR Interspeech 2022 Linguistic-Acoustic Similarity Based Accent Shift for Accent Recognition Interspeech 2022 Minimizing Sequential Confusion Error in Speech Command Recognition Interspeech 2022 Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis Interspeech 2022 Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Dataset Interspeech 2022 Personalized Acoustic Echo Cancellation for Full-duplex Communications Interspeech 2022 WeNet 2.0: More Productive End-to-End Speech Recognition Toolkit Interspeech 2022 AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenario Interspeech 2021 Auto-KWS 2021 Challenge: Task, Datasets, and Baselines Interspeech 2021 Controllable Context-Aware Conversational Speech Synthesis Interspeech 2021 DCCRN+: Channel-Wise Subband DCCRN with SNR Estimation for Speech Enhancement Interspeech 2021 Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-End Speech Recognition Interspeech 2021 Enriching Source Style Transfer in Recognition-Synthesis Based Non-Parallel Voice Conversion Interspeech 2021 F-T-LSTM Based Complex Network for Joint Acoustic Echo Cancellation and Speech Enhancement Interspeech 2021 Glow-WaveGAN: Learning Speech Representations from GAN-Based Variational Auto-Encoder for High Fidelity Flow-Based Speech Synthesis Interspeech 2021 Improving Performance of Seen and Unseen Speech Style Transfer in End-to-End Neural TTS Interspeech 2021 Improving Robustness of One-Shot Voice Conversion with Deep Discriminative Speaker Encoder Interspeech 2021 Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification Interspeech 2021 Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain Interspeech 2021 WeNet: Production Oriented Streaming and Non-Streaming End-to-End Speech Recognition Toolkit Interspeech 2021 An End-to-End Architecture of Online Multi-Channel Speech Separation Interspeech 2020 AutoSpeech 2020: The Second Automated Machine Learning Challenge for Speech Classification Interspeech 2020 Channel-Wise Subband Input for Better Voice and Accompaniment Separation on High Resolution Music Interspeech 2020 Data Efficient Voice Cloning from Noisy Samples with Domain Adversarial Training Interspeech 2020 DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement Interspeech 2020 Exploiting Deep Sentential Context for Expressive End-to-End Speech Synthesis Interspeech 2020 Improving Attention Mechanism in Graph Neural Networks via Cardinality Preservation IJCAI 2020 Inaudible Adversarial Perturbations for Targeted Attack in Speaker Recognition Interspeech 2020 NPU Speaker Verification System for INTERSPEECH 2020 Far-Field Speaker Verification Challenge Interspeech 2020 Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals NeurIPS 2020 Streaming Chunk-Aware Multihead Attention for Online End-to-End Speech Recognition Interspeech 2020 Wake Word Detection with Alignment-Free Lattice-Free MMI Interspeech 2020 Adversarial Regularization for End-to-End Robust Speaker Verification Interspeech 2019 A New GAN-Based End-to-End TTS Training Algorithm Interspeech 2019 Building a Mixed-Lingual Neural TTS System with Only Monolingual Data Interspeech 2019 Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS Interspeech 2019 Improved Speaker-Dependent Separation for CHiME-5 Challenge Interspeech 2019 Towards Language-Universal Mandarin-English Speech Recognition Interspeech 2019 Unsupervised Adaptation with Adversarial Dropout Regularization for Robust Speech Recognition Interspeech 2019 Attention-based End-to-End Models for Small-Footprint Keyword Spotting Interspeech 2018 Empirical Evaluation of Speaker Adaptation on DNN Based Acoustic Model Interspeech 2018 Investigating Generative Adversarial Networks Based Speech Dereverberation for Robust Speech Recognition Interspeech 2018 Learning Acoustic Word Embeddings with Temporal Context for Query-by-Example Speech Search Interspeech 2018 Study of Semi-supervised Approaches to Improving English-Mandarin Code-Switching Speech Recognition Interspeech 2018 Training Augmentation with Adversarial Examples for Robust Speech Recognition Interspeech 2018 Denoising Recurrent Neural Network for Deep Bidirectional LSTM Based Voice Conversion Interspeech 2017 Empirical Evaluation of Parallel Training Algorithms on Acoustic Modeling Interspeech 2017 A DNN-HMM Approach to Story Segmentation Interspeech 2016 Deep Bidirectional LSTM Modeling of Timbre and Prosody for Emotional Voice Conversion Interspeech 2016 Learning Neural Network Representations Using Cross-Lingual Bottleneck Features with Word-Pair Information Interspeech 2016 Toward High-Performance Language-Independent Query-by-Example Spoken Term Detection for MediaEval 2015: Post-Evaluation Analysis Interspeech 2016 Unsupervised Bottleneck Features for Low-Resource Query-by-Example Spoken Term Detection Interspeech 2016 Broadcast News Story Segmentation Using Manifold Learning on Latent Topic Distributions ACL 2013 Combined Use of Speaker- and Tone-Normalized Pitch Reset with Pause Duration for Automatic Story Segmentation in Mandarin Broadcast News NAACL 2007