conftrace_
← Keywords

multimodal learning

4645 papers

Explore in graph

Co-occurring keywords

large language model (13587) vision-language model (2348) visual question answering (1017) video understanding (1658) multi-modal learning (1278) contrastive learning (4032) representation learning (6206) transfer learning (5449) zero-shot learning (3650) vision language model (767)

Papers

LoRA: A Logical Reasoning Augmented Dataset for Visual Question Answering NIPS 2023
INSPECT: A Multimodal Dataset for Patient Outcome Prediction of Pulmonary Embolisms NIPS 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning NIPS 2023
EV-Eye: Rethinking High-frequency Eye Tracking through the Lenses of Event Cameras NIPS 2023
Mass-Producing Failures of Multimodal Systems with Language Models NIPS 2023
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events NIPS 2023
Frozen Language Model Helps ECG Zero-Shot Learning MIDL 2023
TransRP: Transformer-based PET/CT feature extraction incorporating clinical data for recurrence-free survival prediction in oropharyngeal cancer MIDL 2023
MUTEX: Learning Unified Policies from Multimodal Task Specifications CORL 2023
A Universal Semantic-Geometric Representation for Robotic Manipulation CORL 2023
MMEL: A Joint Learning Framework for Multi-Mention Entity Linking UAI 2023
ECNU_MIV at SemEval-2023 Task 1: CTIM - Contrastive Text-Image Model for Multilingual Visual Word Sense Disambiguation SEMEVAL 2023
PoliTo at SemEval-2023 Task 1: CLIP-based Visual-Word Sense Disambiguation Based on Back-Translation SEMEVAL 2023
ML Mob at SemEval-2023 Task 1: Probing CLIP on Visual Word-Sense Disambiguation SEMEVAL 2023
Rutgers Multimedia Image Processing Lab at SemEval-2023 Task-1: Text-Augmentation-based Approach for Visual Word Sense Disambiguation SEMEVAL 2023
SLT at SemEval-2023 Task 1: Enhancing Visual Word Sense Disambiguation through Image Text Retrieval using BLIP SEMEVAL 2023
University of Hildesheim at SemEval-2023 Task 1: Combining Pre-trained Multimodal and Generative Models for Image Disambiguation SEMEVAL 2023
OPI PIB at SemEval-2023 Task 1: A CLIP-based Solution Paired with an Additional Word Context Extension SEMEVAL 2023
LT at SemEval-2023 Task 1: Effective Zero-Shot Visual Word Sense Disambiguation Approaches using External Knowledge Sources SEMEVAL 2023
StFX NLP at SemEval-2023 Task 1: Multimodal Encoding-based Methods for Visual Word Sense Disambiguation SEMEVAL 2023
LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization EACL 2023
Towards a Unified Model for Generating Answers and Explanations in Visual Question Answering EACL 2023
Multimodal Graph Transformer for Multimodal Question Answering EACL 2023
Plausible May Not Be Faithful: Probing Object Hallucination in Vision-Language Pre-training EACL 2023
Reassessing Evaluation Practices in Visual Question Answering: A Case Study on Out-of-Distribution Generalization EACL 2023