conftrace_

cross-modal alignment

263 papers

Explore in graph

Also known as

CMA

Co-occurring keywords

multimodal learning (4645) vision-language model (2348) contrastive learning (4032) multi-modal learning (1278) representation learning (6206) zero-shot learning (3650) large language model (13587) vision language model (767) semantic alignment (324) transfer learning (5449)

Papers

Bridging the Semantic Latent Space between Brain and Machine: Similarity Is All You Need AAAI 2024
SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-Training ICCV 2023
Seeing What You Miss: Vision-Language Pre-Training With Semantic Completion Learning CVPR 2023
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation CVPR 2023
AerialVLN: Vision-and-Language Navigation for UAVs ICCV 2023
Sound Source Localization is All about Cross-Modal Alignment ICCV 2023
LoGoNet: Towards Accurate 3D Object Detection With Local-to-Global Cross-Modal Fusion CVPR 2023
Bayesian Cross-Modal Alignment Learning for Few-Shot Out-of-Distribution Generalization AAAI 2023
Rethinking Multimodal Entity and Relation Extraction from a Translation Point of View ACL 2023
Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment ACL 2023
Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment ACL 2023
AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment ACL 2023
Improving Speech Translation by Fusing Speech and Text EMNLP 2023
Training Simultaneous Speech Translation with Robust and Random Wait-k-Tokens Strategy EMNLP 2023
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding EMNLP 2023
Perceptual Structure in the absence of grounding: the impact of abstractedness and subjectivity in color language for LLMs EMNLP 2023
Granularity Matters: Pathological Graph-driven Cross-modal Alignment for Brain CT Report Generation EMNLP 2023
Query-aware Multi-modal based Ranking Relevance in Video Search EMNLP 2023
TOT：Topology-Aware Optimal Transport for Multimodal Hate Detection AAAI 2023
CoMAE: Single Model Hybrid Pre-training on Small-Scale RGB-D Datasets AAAI 2023
CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition With Variational Alignment CVPR 2023
CALIP: Zero-Shot Enhancement of CLIP with Parameter-Free Attention AAAI 2023
NLIP: Noise-Robust Language-Image Pre-training AAAI 2023
Grounded Entity-Landmark Adaptive Pre-Training for Vision-and-Language Navigation ICCV 2023
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training ICCV 2023