Multimodal Learning

A Multimodal Automated Interpretability Agent ICML 2024 A Multimodal Benchmark and Improved Architecture for Zero Shot Learning WACV 2024 Analyzing Key Factors Influencing Emotion Prediction Performance of VLLMs in Conversational Contexts EMNLP 2024 An Empirical Study Into What Matters for Calibrating Vision-Language Models ICML 2024 An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models ACL 2024 An eye for an ear: zero-shot audio description leveraging an image captioner with audio-visual token distribution matching NeurIPS 2024 An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models ECCV 2024 An Image is Worth Multiple Words: Discovering Object Level Concepts using Multi-Concept Prompt Learning ICML 2024 An image speaks a thousand words, but can everyone listen? On image transcreation for cultural relevance EMNLP 2024 Animal-Bench: Benchmarking Multimodal Video Models for Animal-centric Video Understanding NeurIPS 2024 Annotation-Free Audio-Visual Segmentation WACV 2024 AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model EMNLP 2024 AnyTrans: Translate AnyText in the Image with Large Scale Models EMNLP 2024 ARES: Alternating Reinforcement Learning and Supervised Fine-Tuning for Enhanced Multi-Modal Chain-of-Thought Reasoning Through Diverse AI Feedback EMNLP 2024 ArMeme: Propagandistic Content in Arabic Memes EMNLP 2024 Artemis: Towards Referential Understanding in Complex Videos NeurIPS 2024 A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition CVPR 2024 Attention-Induced Embedding Imputation for Incomplete Multi-View Partial Multi-Label Classification AAAI 2024 Audio Generation with Multiple Conditional Diffusion Model AAAI 2024 Automated Defect Report Generation for Enhanced Industrial Quality Control AAAI 2024 Automated Multi-level Preference for MLLMs NeurIPS 2024 Autonomous Improvement of Instruction Following Skills via Foundation Models CoRL 2024 Autoregressive Pre-Training on Pixels and Texts EMNLP 2024 AutoTrain: No-code training for state-of-the-art models EMNLP 2024 AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection CVPR 2024