conftrace_
← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment ACL 2024
Diffusion Mask-Driven Visual-language Tracking IJCAI 2024
Large Language Models for Time Series: A Survey IJCAI 2024
Seek Commonality but Preserve Differences: Dissected Dynamics Modeling for Multi-modal Visual RL NIPS 2024
ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos ACL 2024
Matryoshka Query Transformer for Large Vision-Language Models NIPS 2024
SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs ACL 2024
Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach ACL 2024
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources ACL 2024
OLIVE: Object Level In-Context Visual Embeddings ACL 2024
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024
Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models ACL 2024
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? ACL 2024
Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction ACL 2024
MMToM-QA: Multimodal Theory of Mind Question Answering ACL 2024
Don’t Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models ACL 2024
OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios ACL 2024
LEGENT: Open Platform for Embodied Agents ACL 2024
MoExtend: Tuning New Experts for Modality and Task Extension ACL 2024
Large Language Models can Share Images, Too! ACL 2024
You Only Look at Screens: Multimodal Chain-of-Action Agents ACL 2024
Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality ACL 2024
Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding ACL 2024
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation ACL 2024
AIRI at RRG24: LLaVa with specialised encoder and decoder ACL 2024