conftrace_

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

Pengi: An Audio Language Model for Audio Tasks NIPS 2023

LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation NIPS 2023

Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning NIPS 2023

Visual Instruction Tuning NIPS 2023

Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Models NIPS 2023

Large Language Models are Visual Reasoning Coordinators NIPS 2023

Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception NIPS 2023

Revisit Weakly-Supervised Audio-Visual Video Parsing from the Language Perspective NIPS 2023

PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation NIPS 2023

DQ-DETR: Dual Query Detection Transformer for Phrase Extraction and Grounding AAAI 2023

Towards Real-Time Panoptic Narrative Grounding by an End-to-End Grounding Network AAAI 2023

Retraction Note to: McOmet: Multimodal Fusion Transformer for Physical Audiovisual Commonsense Reasoning AAAI 2023

Leveraging Modality-Specific Representations for Audio-Visual Speech Recognition via Reinforcement Learning AAAI 2023

PATRON: Perspective-Aware Multitask Model for Referring Expression Grounding Using Embodied Multimodal Cues AAAI 2023

Just Noticeable Visual Redundancy Forecasting: A Deep Multimodal-Driven Approach AAAI 2023

Bootstrapping Multi-View Representations for Fake News Detection AAAI 2023

Joint Multimodal Entity-Relation Extraction Based on Edge-Enhanced Graph Alignment Network and Word-Pair Relation Tagging AAAI 2023

SPRING: Situated Conversation Agent Pretrained with Multimodal Questions from Incremental Layout Graph AAAI 2023

MPMQA: Multimodal Question Answering on Product Manuals AAAI 2023

World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models ACL 2023

Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling ACL 2023

QAP: A Quantum-Inspired Adaptive-Priority-Learning Model for Multimodal Emotion Recognition ACL 2023

Emotions in Spoken Language - Do we need acoustics? ACL 2023

Do Androids Laugh at Electric Sheep? Humor “Understanding” Benchmarks from The New Yorker Caption Contest ACL 2023

University of Hildesheim at SemEval-2023 Task 1: Combining Pre-trained Multimodal and Generative Models for Image Disambiguation ACL 2023