audio-visual speech recognition

AVFormer: Injecting Vision Into Frozen Speech Models for Zero-Shot AV-ASR CVPR 2023 Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition IJCAI 2023 Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition ACL 2023 Intuitive Multilingual Audio-Visual Speech Recognition with a Single-Trained Model EMNLP 2023 Leveraging Modality-Specific Representations for Audio-Visual Speech Recognition via Reinforcement Learning AAAI 2023 MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information Interspeech 2023 MIR-GAN: Refining Frame-Level Modality-Invariant Representations with Adversarial Network for Audio-Visual Speech Recognition ACL 2023 MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation Interspeech 2023 Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization Interspeech 2023 Streaming Audio-Visual Speech Recognition with Alignment Regularization Interspeech 2023 Watch or Listen: Robust Audio-Visual Speech Recognition With Visual Corruption Modeling and Reliability Scoring CVPR 2023 Audio-Visual Generalized Few-Shot Learning with Prototype-Based Co-Adaptation Interspeech 2022 Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysis Interspeech 2022 AVATAR: Unconstrained Audiovisual Speech Recognition Interspeech 2022 Cross-Modal Mutual Learning for Audio-Visual Speech Recognition and Manipulation AAAI 2022 DAVIS: Driver’s Audio-Visual Speech recognition Interspeech 2022 Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition ACL 2022 Robust Self-Supervised Audio-Visual Speech Recognition Interspeech 2022 Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition for Single and Muti-Person Video Interspeech 2022 Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition Interspeech 2022 Audio-Visual Multi-Talker Speech Recognition in a Cocktail Party Interspeech 2021 End-to-End Audio-Visual Speech Recognition for Overlapping Speech Interspeech 2021 Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading CVPR 2021 Discriminative Multi-Modality Speech Recognition CVPR 2020 Exploiting Cross-Domain Visual Feature Generation for Disordered Speech Recognition Interspeech 2020