Papers
The role of audio-visual integration in the time course of phonetic encoding in self-supervised speech models
Yi Wang, Oli Danyi Liu, Peter Bell
Enhanced Hybrid Transducer and Attention Encoder Decoder with Text Data
Yun Tang, Eesung Kim, Vijendra Raj Apsingekar
U-SAM: An Audio Language Model for Unified Speech, Audio, and Music Understanding
Ziqian Wang, Xianjun Xia, Xinfa Zhu et al.
Efficient and Direct Duplex Modeling for Speech-to-Speech Language Model
Ke Hu, Ehsan Hosseini-Asl, Chen Chen et al.
PAEFF: Precise Alignment and Enhanced Gated Feature Fusion for Face-Voice Association
Abdul Hannan, Muhammad Arslan Manzoor, Shah Nawaz et al.
CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge
Zehua Liu, Xiaolou Li, Chen Chen et al.
SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer
Orchid Chetia Phukan, Mohd Mujtaba Akhtar, Girish et al.
GIA-MIC: Multimodal Emotion Recognition with Gated Interactive Attention and Modality-Invariant Learning Constraints
Jiajun He, Jinyi Mi, Tomoki Toda
CAMER: Contribution-Aware Multimodal Emotion Recognition
Sun-Kyung Lee, Jong-Hwan Kim
SpokenNativQA: Multilingual Everyday Spoken Queries for LLMs
Firoj Alam, Md Arid Hasan, Shammur Absar Chowdhury
GraphemeAug: A Systematic Approach to Synthesized Hard Negative Keyword Spotting Examples
Harry Zhang, Kurt Partridge, Pai Zhu et al.
LLM-Synth4KWS: Scalable Automatic Generation and Synthesis of Confusable Data for Custom Keyword Spotting
Pai Zhu, Quan Wang, Dhruuv Agarwal et al.
Multichannel Keyword Spotting for Noisy Conditions
Dzmitry Saladukha, Ivan Koriabkin, Kanstantsin Artsiom et al.
SIDC-KWS: Efficient Spiking Inception-Dilated Conformer with Self-Attention for Keyword Spotting
Jin Gyo Lim, Seong Eun Kim
On Retrieval of Long Audios with Complex Text Queries
Ruochu Yang, Milind Rao, Harshavardhan Sundar et al.
Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learning
Changin Choi, Sungjun Lim, Wonjong Rhee
GTA: Towards Generative Text-To-Audio Retrieval via Multi-Scale Tokenizer
Minghui Fang, Shengpeng Ji, Jialong Zuo et al.
Adversarial Deep Metric Learning for Cross-Modal Audio-Text Alignment in Open-Vocabulary Keyword Spotting
Youngmoon Jung, Yong-Hyeok Lee, Myunghun Jung et al.
Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval
Ruofan Hu, Yan Xia, Minjie Hong et al.
H-QuEST: Accelerating Query-by-Example Spoken Term Detection with Hierarchical Indexing
Akanksha Singh, Yi-Ping Phoebe Chen, Vipul Arora
Language-Agnostic Speech Tokenizer for Spoken Term Detection with Efficient Retrieval
Anup Singh, Kris Demuynck, Vipul Arora
An Effective Anomalous Sound Detection Method Based on Global and Local Attribute Mining
Nan Jiang, Yan Song, Qing Gu et al.
Anomalous Sound Detection Based Feature Fusion and Dual-path Non-linear Independent Components Estimation
Yawei Wang, Qiaoling Zhang, Yi Zhang et al.
AC/DC: LLM-based Audio Comprehension via Dialogue Continuation
Yusuke Fujita, Tomoya Mizumoto, Atsushi Kojima et al.
Language-Guided Contrastive Audio-Visual Masked Autoencoder with Automatically Generated Audio-Visual-Text Triplets from Videos
Yuchi Ishikawa, Shota Nakada, Hokuto Munakata et al.