Multimodal Learning

On the generalization capacity of neural networks during generic multimodal reasoning ICLR 2024 On the Language Encoder of Contrastive Cross-modal Models ACL 2024 On the Limits of Multi-modal Meta-Learning with Auxiliary Task Modulation Using Conditional Batch Normalization NAACL 2024 On The Performance of EMA-synchronized Speech and Stand-alone Speech in Acoustic-to-articulatory Inversion Interspeech 2024 On the Robustness of Language Guidance for Low-Level Vision Tasks: Findings from Depth Estimation CVPR 2024 On the Robustness of Large Multimodal Models Against Image Adversarial Attacks CVPR 2024 On the Success and Limitations of Auxiliary Network Based Word-Level End-to-End Neural Speaker Diarization Interspeech 2024 On the Test-Time Zero-Shot Generalization of Vision-Language Models: Do We Really Need Prompt Learning? CVPR 2024 Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationships CVPR 2024 OpenDlign: Open-World Point Cloud Understanding with Depth-Aligned Images NeurIPS 2024 Open-ended VQA benchmarking of Vision-Language models by exploiting Classification datasets and their semantic hierarchy ICLR 2024 OpenEQA: Embodied Question Answering in the Era of Foundation Models CVPR 2024 OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models NAACL 2024 OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understanding NeurIPS 2024 OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Views ICLR 2024 Open-NeRF: Towards Open Vocabulary NeRF Decomposition WACV 2024 OpenOmni: A Collaborative Open Source Tool for Building Future-Ready Multimodal Conversational Agents EMNLP 2024 OpenSep: Leveraging Large Language Models with Textual Inversion for Open World Audio Separation EMNLP 2024 OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios ACL 2024 Open-Vocabulary 3D Semantic Segmentation with Foundation Models CVPR 2024 Open-Vocabulary Federated Learning with Multimodal Prototyping NAACL 2024 Open-Vocabulary Segmentation with Semantic-Assisted Calibration CVPR 2024 Open Vocabulary Semantic Scene Sketch Understanding CVPR 2024 Open-Vocabulary Video Relation Extraction AAAI 2024 OpenWebAgent: An Open Toolkit to Enable Web Agents on Large Language Models ACL 2024