← Learning Types
Deep Learning › Learning Types ›

Multi-Modal Learning

3194 directly classified papers

Papers per year

Papers

Kaleido Diffusion: Improving Conditional Diffusion Models with Autoregressive Latent Modeling NIPS 2024
Unified Insights: Harnessing Multi-modal Data for Phenotype Imputation via View Decoupling NIPS 2024
Unified Lexical Representation for Interpretable Visual-Language Alignment NIPS 2024
FIRE: Food Image to REcipe Generation WACV 2024
Egocentric Action Recognition by Capturing Hand-Object Contact and Object State WACV 2024
In-Context Compositional Generalization for Large Vision-Language Models EMNLP 2024
STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics NIPS 2024
Counting Crowds in Bad Weather ICCV 2023
Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video ICCV 2023
The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion ICCV 2023
Recursive Video Lane Detection ICCV 2023
UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Framework ICCV 2023
MMST-ViT: Climate Change-aware Crop Yield Prediction via Multi-Modal Spatial-Temporal Vision Transformer ICCV 2023
Multi-Modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusion ICCV 2023
RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation ICCV 2023
HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending ICCV 2023
MethaneMapper: Spectral Absorption Aware Hyperspectral Transformer for Methane Detection CVPR 2023
Unified Coarse-to-Fine Alignment for Video-Text Retrieval ICCV 2023
NeRFInvertor: High Fidelity NeRF-GAN Inversion for Single-Shot Real Image Animation CVPR 2023
An Empirical Study of End-to-End Video-Language Transformers With Masked Visual Modeling CVPR 2023
Revisiting Temporal Modeling for CLIP-Based Image-to-Video Knowledge Transferring CVPR 2023
AutoLabel: CLIP-Based Framework for Open-Set Video Domain Adaptation CVPR 2023
Aligning Step-by-Step Instructional Diagrams to Video Demonstrations CVPR 2023
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion ACL 2023
TableVLM: Multi-modal Pre-training for Table Structure Recognition ACL 2023