Multimodal Learning

PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systems EMNLP 2024 PSST: A Benchmark for Evaluation-driven Text Public-Speaking Style Transfer EMNLP 2024 PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns ACL 2024 Qalam: A Multimodal LLM for Arabic Optical Character and Handwriting Recognition ACL 2024 Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision ICLR 2024 QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition CVPR 2024 QFNU_CS at SemEval-2024 Task 3: A Hybrid Pre-trained Model based Approach for Multimodal Emotion-Cause Pair Extraction Task SemEval 2024 Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models CVPR 2024 Quantifying and Enhancing Multi-modal Robustness with Modality Preference ICLR 2024 Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective EMNLP 2024 Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval EMNLP 2024 Quantifying the Impact of Disfluency on Spoken Content Summarization COLING 2024 Quartet@LT-EDI 2024: A SVM-ResNet50 Approach For Multitask Meme Classification - Unraveling Misogynistic and Trolls in Online Memes EACL 2024 Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM EMNLP 2024 Query-Guided Attention in Vision Transformers for Localizing Objects Using a Single Sketch WACV 2024 Querying as Prompt: Parameter-Efficient Learning for Multimodal Language Model CVPR 2024 Question Aware Vision Transformer for Multimodal Reasoning CVPR 2024 Question Calibration and Multi-Hop Modeling for Temporal Question Answering AAAI 2024 Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos CVPR 2024 Q-VLM: Post-training Quantization for Large Vision-Language Models NeurIPS 2024 R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding ECCV 2024 RadarMOSEVE: A Spatial-Temporal Transformer Network for Radar-Only Moving Object Segmentation and Ego-Velocity Estimation AAAI 2024 RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models EMNLP 2024 Rainbow - A Benchmark for Systematic Testing of How Sensitive Visio-Linguistic Models are to Color Naming EACL 2024 RAM-Avatar: Real-time Photo-Realistic Avatar from Monocular Videos with Full-body Control CVPR 2024