Multimodal Learning

Sparse-to-dense Multimodal Image Registration via Multi-Task Learning ICML 2024 Spatially-Aware Speaker for Vision-and-Language Navigation Instruction Generation ACL 2024 SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors NeurIPS 2024 SpatialRGPT: Grounded Spatial Reasoning in Vision-Language Models NeurIPS 2024 Spatial-Semantic Collaborative Cropping for User Generated Content AAAI 2024 SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities CVPR 2024 Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals Interspeech 2024 Speaker- and Text-Independent Estimation of Articulatory Movements and Phoneme Alignments from Speech Interspeech 2024 SpeakerBeam-SS: Real-time Target Speaker Extraction with Lightweight Conv-TasNet and State Space Modeling Interspeech 2024 Speakers Unembedded: Embedding-free Approach to Long-form Neural Diarization Interspeech 2024 Speaking of Health: Leveraging Large Language Models to assess Exercise Motivation and Behavior of Rehabilitation Patients Interspeech 2024 Speech After Gender: A Trans-Feminine Perspective on Next Steps for Speech Science and Technology Interspeech 2024 SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection NeurIPS 2024 SpeechGuard: Exploring the Adversarial Robustness of Multi-modal Large Language Models ACL 2024 Speech Is More than Words: Do Speech-to-Text Translation Systems Leverage Prosody? EMNLP 2024 Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer ACL 2024 Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? ACL 2024 Speech vs. Transcript: Does It Matter for Human Annotators in Speech Summarization? ACL 2024 Speechworthy Instruction-tuned Language Models EMNLP 2024 SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models ICML 2024 Spider: A Unified Framework for Context-dependent Concept Segmentation ICML 2024 SPIDeRS: Structured Polarization for Invisible Depth and Reflectance Sensing CVPR 2024 Spike-based Neuromorphic Model for Sound Source Localization NeurIPS 2024 Spiking Neural Network as Adaptive Event Stream Slicer NeurIPS 2024 SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks CVPR 2024