multimodal learning

Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer AAAI 2024 Prompt Learning with Quaternion Networks ICLR 2024 Propensity Score Alignment of Unpaired Multimodal Data NeurIPS 2024 Prospector Heads: Generalized Feature Attribution for Large Models & Data ICML 2024 Prot2Text: Multimodal Protein’s Function Generation with GNNs and Transformers AAAI 2024 ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training ACL 2024 Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction ICLR 2024 ProtT3: Protein-to-Text Generation for Text-based Protein Understanding ACL 2024 PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systems EMNLP 2024 PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns ACL 2024 Qalam: A Multimodal LLM for Arabic Optical Character and Handwriting Recognition ACL 2024 Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision ICLR 2024 QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition CVPR 2024 QFNU_CS at SemEval-2024 Task 3: A Hybrid Pre-trained Model based Approach for Multimodal Emotion-Cause Pair Extraction Task SemEval 2024 Quantifying and Enhancing Multi-modal Robustness with Modality Preference ICLR 2024 Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval EMNLP 2024 Quartet@LT-EDI 2024: A SVM-ResNet50 Approach For Multitask Meme Classification - Unraveling Misogynistic and Trolls in Online Memes EACL 2024 Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM EMNLP 2024 Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos CVPR 2024 RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Multi-Modal Large Language Model Learning RSS 2024 RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation CoRL 2024 Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoning WACV 2024 RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detection CVPR 2024 Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding EMNLP 2024 ReadLet: A Dataset for Oral, Visual and Tactile Text Reading Data of Early and Mature Readers COLING 2024