conftrace_
← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents NIPS 2023
MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation NIPS 2023
LoRA: A Logical Reasoning Augmented Dataset for Visual Question Answering NIPS 2023
INSPECT: A Multimodal Dataset for Patient Outcome Prediction of Pulmonary Embolisms NIPS 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning NIPS 2023
EV-Eye: Rethinking High-frequency Eye Tracking through the Lenses of Event Cameras NIPS 2023
Mass-Producing Failures of Multimodal Systems with Language Models NIPS 2023
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events NIPS 2023
Frozen Language Model Helps ECG Zero-Shot Learning MIDL 2023
TransRP: Transformer-based PET/CT feature extraction incorporating clinical data for recurrence-free survival prediction in oropharyngeal cancer MIDL 2023
MUTEX: Learning Unified Policies from Multimodal Task Specifications CORL 2023
A Universal Semantic-Geometric Representation for Robotic Manipulation CORL 2023
MMEL: A Joint Learning Framework for Multi-Mention Entity Linking UAI 2023
ECNU_MIV at SemEval-2023 Task 1: CTIM - Contrastive Text-Image Model for Multilingual Visual Word Sense Disambiguation SEMEVAL 2023
PoliTo at SemEval-2023 Task 1: CLIP-based Visual-Word Sense Disambiguation Based on Back-Translation SEMEVAL 2023
ML Mob at SemEval-2023 Task 1: Probing CLIP on Visual Word-Sense Disambiguation SEMEVAL 2023
Rutgers Multimedia Image Processing Lab at SemEval-2023 Task-1: Text-Augmentation-based Approach for Visual Word Sense Disambiguation SEMEVAL 2023
SLT at SemEval-2023 Task 1: Enhancing Visual Word Sense Disambiguation through Image Text Retrieval using BLIP SEMEVAL 2023
University of Hildesheim at SemEval-2023 Task 1: Combining Pre-trained Multimodal and Generative Models for Image Disambiguation SEMEVAL 2023
OPI PIB at SemEval-2023 Task 1: A CLIP-based Solution Paired with an Additional Word Context Extension SEMEVAL 2023
LT at SemEval-2023 Task 1: Effective Zero-Shot Visual Word Sense Disambiguation Approaches using External Knowledge Sources SEMEVAL 2023
StFX NLP at SemEval-2023 Task 1: Multimodal Encoding-based Methods for Visual Word Sense Disambiguation SEMEVAL 2023
LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization EACL 2023
Towards a Unified Model for Generating Answers and Explanations in Visual Question Answering EACL 2023
Multimodal Graph Transformer for Multimodal Question Answering EACL 2023