conftrace_

large multimodal model

184 papers

Explore in graph

Also known as

LMM

Co-occurring keywords

multimodal learning (4645) visual question answering (1017) large language model (13587) benchmark evaluation (1556) vision-language model (2348) visual reasoning (493) multimodal model (110) instruction tuning (838) zero-shot learning (3650) video understanding (1658)

Papers

MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens NIPS 2024
GLaMM: Pixel Grounding Large Multimodal Model CVPR 2024
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning CVPR 2024
GlitchBench: Can Large Multimodal Models Detect Video Game Glitches? CVPR 2024
Improved Baselines with Visual Instruction Tuning CVPR 2024
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts CVPR 2024
ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts CVPR 2024
ARES: Alternating Reinforcement Learning and Supervised Fine-Tuning for Enhanced Multi-Modal Chain-of-Thought Reasoning Through Diverse AI Feedback EMNLP 2024
What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models EMNLP 2024