conftrace_

multimodal large language model

966 papers

Explore in graph

Also known as

MLLMS M-LLM MLLM

Co-occurring keywords

multimodal learning (4645) benchmark evaluation (1556) large language model (13587) visual question answering (1017) visual reasoning (493) video understanding (1658) instruction tuning (838) vision-language model (2348) chain-of-thought reasoning (551) visual grounding (518)

Papers

Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs CVPR 2024
Exploring the Transferability of Visual Prompting for Multimodal Large Language Models CVPR 2024
Cloud-Device Collaborative Learning for Multimodal Large Language Models CVPR 2024
Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding EMNLP 2024
mDPO: Conditional Preference Optimization for Multimodal Large Language Models EMNLP 2024
Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale EMNLP 2024
To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models EMNLP 2024
How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning? EMNLP 2024
By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting EMNLP 2024
Tag-grounded Visual Instruction Tuning with Retrieval Augmentation EMNLP 2024
TinyChart: Efficient Chart Understanding with Program-of-Thoughts Learning and Visual Token Merging EMNLP 2024
EFUF: Efficient Fine-Grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models EMNLP 2024
GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation EMNLP 2024
Introducing GenCeption for Multimodal LLM Benchmarking: You May Bypass Annotations NAACL 2024
DeepPavlov at SemEval-2024 Task 3: Multimodal Large Language Models in Emotion Reasoning NAACL 2024
DeepPavlov at SemEval-2024 Task 3: Multimodal Large Language Models in Emotion Reasoning SEMEVAL 2024
DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing INTERSPEECH 2024
Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation ACL 2024
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA ACL 2024
Unified Hallucination Detection for Multimodal Large Language Models ACL 2024
Multimodal Instruction Tuning with Conditional Mixture of LoRA ACL 2024
Mementos: A Comprehensive Benchmark for Multimodal Large Language Model Reasoning over Image Sequences ACL 2024
Safety of Multimodal Large Language Models on Images and Text IJCAI 2024
GRASP: A Novel Benchmark for Evaluating Language GRounding and Situated Physics Understanding in Multimodal Language Models IJCAI 2024
VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks NIPS 2024