conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

Large Language Models for Time Series: A Survey IJCAI 2024
Seek Commonality but Preserve Differences: Dissected Dynamics Modeling for Multi-modal Visual RL NIPS 2024
ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos ACL 2024
Matryoshka Query Transformer for Large Vision-Language Models NIPS 2024
SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs ACL 2024
Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach ACL 2024
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources ACL 2024
OLIVE: Object Level In-Context Visual Embeddings ACL 2024
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024
Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models ACL 2024
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? ACL 2024
Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction ACL 2024
MMToM-QA: Multimodal Theory of Mind Question Answering ACL 2024
Don’t Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models ACL 2024
OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios ACL 2024
LEGENT: Open Platform for Embodied Agents ACL 2024
MoExtend: Tuning New Experts for Modality and Task Extension ACL 2024
Large Language Models can Share Images, Too! ACL 2024
You Only Look at Screens: Multimodal Chain-of-Action Agents ACL 2024
Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality ACL 2024
Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding ACL 2024
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation ACL 2024
AIRI at RRG24: LLaVa with specialised encoder and decoder ACL 2024
Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmark ACL 2024
Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality EMNLP 2024