conftrace_
← Keywords

multimodal learning

4622 papers

Explore in graph

Also known as

VLM VLLM MM VLA MLLMS MLM MML MULLM LMM MLLM MMT

Co-occurring keywords

large language model (12755) vision-language model (2235) visual question answering (1000) video understanding (1647) multi-modal learning (1276) contrastive learning (3979) representation learning (6174) transfer learning (5442) zero-shot learning (3637) vision language model (752)

Papers

ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation EACL 2023
Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features RSS 2023
ASIF: Coupled Data Turns Unimodal Models to Multimodal without Training NIPS 2023
MultiVENT: Multilingual Videos of Events and Aligned Natural Text NIPS 2023
Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model INTERSPEECH 2023
Visualize Before You Write: Imagination-Guided Open-Ended Text Generation EACL 2023
Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis EACL 2023
Language-guided Robot Grasping: CLIP-based Referring Grasp Synthesis in Clutter CORL 2023
Learning to Taste: A Multimodal Wine Dataset NIPS 2023
$α$-MDF: An Attention-based Multimodal Differentiable Filter for Robot State Estimation CORL 2023
Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine NIPS 2023
VidChapters-7M: Video Chapters at Scale NIPS 2023
FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Space NIPS 2023
Beyond Unimodal: Generalising Neural Processes for Multimodal Uncertainty Estimation NIPS 2023
StressID: a Multimodal Dataset for Stress Identification NIPS 2023
Video Timeline Modeling For News Story Understanding NIPS 2023
VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models NIPS 2023
Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models NIPS 2023
Generating Images with Multimodal Language Models NIPS 2023
4M: Massively Multimodal Masked Modeling NIPS 2023
Human-Centred Multimodal Deep Learning Models for Chest X-Ray Diagnosis IJCAI 2023
Integration-free Training for Spatio-temporal Multimodal Covariate Deep Kernel Point Processes NIPS 2023
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge ICCV 2023
ProbVLM: Probabilistic Adapter for Frozen Vison-Language Models ICCV 2023
Benchmarking Diverse-Modal Entity Linking with Generative Models ACL 2023