Multimodal Learning

Spatialization Quality Metric for Binaural Speech Interspeech 2023 Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning Interspeech 2023 Spatio-Temporal Meta-Graph Learning for Traffic Forecasting AAAI 2023 Speaker-aware Cross-modal Fusion Architecture for Conversational Emotion Recognition Interspeech 2023 Speaker Extraction with Detection of Presence and Absence of Target Speakers Interspeech 2023 Speaker Tracking using Graph Attention Networks with Varying Duration Utterances across Multi-Channel Naturalistic Data: Fearless Steps Apollo-11 Audio Corpus Interspeech 2023 Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Units EMNLP 2023 Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind ACL 2023 Speech4Mesh: Speech-Assisted Monocular 3D Facial Reconstruction for Speech-Driven 3D Facial Animation ICCV 2023 Speech Aware Dialog System Technology Challenge (DSTC11) Interspeech 2023 SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities EMNLP 2023 Speech Synthesis with Self-Supervisedly Learnt Prosodic Representations Interspeech 2023 Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment ACL 2023 Speech-to-Face Conversion Using Denoising Diffusion Probabilistic Models Interspeech 2023 SPLIT: Stance and Persuasion Prediction with Multi-modal on Image and Textual Information EMNLP 2023 SPM: A Split-Parsing Method for Joint Multi-Intent Detection and Slot Filling ACL 2023 SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agents NeurIPS 2023 Spontaneous gestures encoded by hand positions improve language models: An Information-Theoretic motivated study ACL 2023 Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus ICLR 2023 SPRING: Situated Conversation Agent Pretrained with Multimodal Questions from Incremental Layout Graph AAAI 2023 SQA3D: Situated Question Answering in 3D Scenes ICLR 2023 SRCB at SemEval-2023 Task 1: Prompt Based and Cross-Modal Retrieval Enhanced Visual Word Sense Disambiguation SemEval 2023 Stable and low-precision training for large-scale vision-language models NeurIPS 2023 StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with Offset IJCAI 2023 Standardizing Distress Analysis: Emotion-Driven Distress Identification and Cause Extraction (DICE) in Multimodal Online Posts EMNLP 2023