conftrace_

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

***YesBut***: A High-Quality Annotated Multimodal Dataset for evaluating Satire Comprehension capability of Vision-Language Models EMNLP 2024

MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification EMNLP 2024

RECANTFormer: Referring Expression Comprehension with Varying Numbers of Targets EMNLP 2024

Exploring Question Guidance and Answer Calibration for Visually Grounded Video Question Answering EMNLP 2024

Mitigating Object Hallucination via Concentric Causal Attention NIPS 2024

Multilingual Diversity Improves Vision-Language Representations NIPS 2024

Hidden in Plain Sight: Evaluating Abstract Shape Recognition in Vision-Language Models NIPS 2024

WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NIPS 2024

SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection NIPS 2024

DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ NIPS 2024

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling NIPS 2024

SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM NIPS 2024

Decomposing and Interpreting Image Representations via Text in ViTs Beyond CLIP NIPS 2024

GTA: A Benchmark for General Tool Agents NIPS 2024

OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents NIPS 2024

OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding NIPS 2024

Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioning NIPS 2024

Multi-Object Hallucination in Vision Language Models NIPS 2024

ChatTracker: Enhancing Visual Tracking Performance via Chatting with Multimodal Large Language Model NIPS 2024

Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment NIPS 2024

ArMeme: Propagandistic Content in Arabic Memes EMNLP 2024

MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs NIPS 2024

MultiClimate: Multimodal Stance Detection on Climate Change Videos EMNLP 2024

From Language to Pixels: Task Recognition and Task Learning in LLMs EMNLP 2024

Image-conditioned human language comprehension and psychometric benchmarking of visual language models EMNLP 2024