conftrace_

large multimodal model

184 papers

Explore in graph

Also known as

LMM

Co-occurring keywords

multimodal learning (4645) visual question answering (1017) large language model (13587) benchmark evaluation (1556) vision-language model (2348) visual reasoning (493) multimodal model (110) instruction tuning (838) zero-shot learning (3650) video understanding (1658)

Papers

Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning NIPS 2024
A Concept-Based Explainability Framework for Large Multimodal Models NIPS 2024
Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights EMNLP 2024
Compositional Chain-of-Thought Prompting for Large Multimodal Models CVPR 2024
LEGENT: Open Platform for Embodied Agents ACL 2024
Selectively Answering Visual Questions ACL 2024
On the Robustness of Large Multimodal Models Against Image Adversarial Attacks CVPR 2024
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective ACL 2024
Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model EMNLP 2024
Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant EMNLP 2024
M5 – A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks EMNLP 2024
Synthetic Multimodal Question Generation EMNLP 2024
Yo'LLaVA: Your Personalized Language and Vision Assistant NIPS 2024
OpenWebAgent: An Open Toolkit to Enable Web Agents on Large Language Models ACL 2024
Towards Low-Resource Harmful Meme Detection with LMM Agents EMNLP 2024
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering EMNLP 2024
DocEdit-v2: Document Structure Editing Via Multimodal LLM Grounding EMNLP 2024
MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification EMNLP 2024
MultiSkill: Evaluating Large Multimodal Models for Fine-grained Alignment Skills EMNLP 2024
MuEP: A Multimodal Benchmark for Embodied Planning with Foundation Models IJCAI 2024
UMass-BioNLP at MEDIQA-M3G 2024: DermPrompt - A Systematic Exploration of Prompt Engineering with GPT-4V for Dermatological Diagnosis NAACL 2024
An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Models EMNLP 2024
MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning NAACL 2024
See Say and Segment: Teaching LMMs to Overcome False Premises CVPR 2024