conftrace_

multimodal large language model

966 papers

Explore in graph

Also known as

MLLMS M-LLM MLLM

Co-occurring keywords

multimodal learning (4645) benchmark evaluation (1556) large language model (13587) visual question answering (1017) visual reasoning (493) video understanding (1658) instruction tuning (838) vision-language model (2348) chain-of-thought reasoning (551) visual grounding (518)

Papers

Whiteboard-of-Thought: Thinking Step-by-Step Across Modalities EMNLP 2024
MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance EMNLP 2024
CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation ACL 2024
MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing ACL 2024
Evolutionary Reward Design and Optimization with Multimodal Large Language Models ACL 2024
Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline ACL 2024
Optimizing Multimodal Large Language Models for Detection of Alcohol Advertisements via Adaptive Prompting ACL 2024
Dallah: A Dialect-Aware Multimodal Large Language Model for Arabic ACL 2024
VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Tool ACL 2024
MM-SOC: Benchmarking Multimodal Large Language Models in Social Media Platforms ACL 2024
MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question Answering ACL 2024
InfiMM: Advancing Multimodal Understanding with an Open-Sourced Visual Language Model ACL 2024
ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction ACL 2024
Cross-Modal Projection in Multimodal LLMs Doesn’t Really Project Visual Attributes to Textual Space ACL 2024
REFINESUMM: Self-Refining MLLM for Generating a Multimodal Summarization Dataset ACL 2024
VIGC: Visual Instruction Generation and Correction AAAI 2024
PathAsst: A Generative Foundation AI Assistant towards Artificial General Intelligence of Pathology AAAI 2024
RealDex: Towards Human-like Grasping for Robotic Dexterous Hand IJCAI 2024
ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning IJCAI 2024
EIVEN: Efficient Implicit Attribute Value Extraction using Multimodal LLM NAACL 2024
SERPENT-VLM : Self-Refining Radiology Report Generation Using Vision Language Models NAACL 2024
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs? NAACL 2024
From Multimodal LLM to Human-level AI: Modality, Instruction, Reasoning, Efficiency and beyond COLING 2024
A Multimodal Large Language Model “Foresees” Objects Based on Verb Information but Not Gender CONLL 2024
Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks NIPS 2024