Multimodal Learning

AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models EMNLP 2024 Automated Camera Calibration via Homography Estimation With GNNs WACV 2024 Automated Multi-level Preference for MLLMs NeurIPS 2024 Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output NAACL 2024 AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ ICLR 2024 Autonomous Aspect-Image Instruction a2II: Q-Former Guided Multimodal Sentiment Classification COLING 2024 Autonomous Interactive Correction MLLM for Robust Robotic Manipulation CoRL 2024 Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality ACL 2024 Autoregressive Pre-Training on Pixels and Texts EMNLP 2024 AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation CVPR 2024 AVCap: Leveraging Audio-Visual Features as Text Tokens for Captioning Interspeech 2024 AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection CVPR 2024 AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis NeurIPS 2024 A Virtual Patient Dialogue System Based on Question-Answering on Clinical Records COLING 2024 A Vision Check-up for Language Models CVPR 2024 AV-RIR: Audio-Visual Room Impulse Response Estimation CVPR 2024 AVR: synergizing foundation models for audio-visual humor detection Interspeech 2024 AVSegFormer: Audio-Visual Segmentation with Transformer AAAI 2024 A Workflow for HTR-Postprocessing, Labeling and Classifying Diachronic and Regional Variation in Pre-Modern Slavic Texts COLING 2024 AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation NeurIPS 2024 BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP CVPR 2024 Balancing Multimodal Learning via Online Logit Modulation IJCAI 2024 Balancing Similarity and Complementarity for Federated Learning ICML 2024 Balancing Visual Context Understanding in Dialogue for Image Retrieval EMNLP 2024 BarLeRIa: An Efficient Tuning Framework for Referring Image Segmentation ICLR 2024