conftrace_

modality gap

49 papers

Explore in graph

Co-occurring keywords

cross-modal alignment (263) vision-language model (2348) multimodal learning (4645) contrastive learning (4032) multi-modal learning (1278) representation learning (6206) vision language model (767) speech translation (416) cross-modal learning (525) zero-shot learning (3650)

Papers

Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment AAAI 2024
Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models EMNLP 2024
Multi-Level Cross-Modal Alignment for Speech Relation Extraction EMNLP 2024
Split to Merge: Unifying Separated Modalities for Unsupervised Domain Adaptation CVPR 2024
Accept the Modality Gap: An Exploration in the Hyperbolic Space CVPR 2024
Bridge the Modality and Capability Gaps in Vision-Language Model Selection NIPS 2024
CLIP-FSAC: Boosting CLIP for Few-Shot Anomaly Classification with Synthetic Anomalies IJCAI 2024
Generating More Audios for End-to-End Spoken Language Understanding IJCAI 2024
C2KD: Bridging the Modality Gap for Cross-Modal Knowledge Distillation CVPR 2024
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation NAACL 2024
Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-Identification CVPR 2023
Shape-Erased Feature Learning for Visible-Infrared Person Re-Identification CVPR 2023
AdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translation EMNLP 2023
Pre-training for Speech Translation: CTC Meets Optimal Transport ICML 2023
PEIT: Bridging the Modality Gap with Pre-trained Models for End-to-End Image Translation ACL 2023
Modality Adaption or Regularization? A Case Study on End-to-End Speech Translation ACL 2023
Intra-Modal Proxy Learning for Zero-Shot Visual Categorization with CLIP NIPS 2023
TOT：Topology-Aware Optimal Transport for Multimodal Hate Detection AAAI 2023
Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identification AAAI 2023
Unsupervised Visible-Infrared Person Re-Identification via Progressive Graph Matching and Alternate Learning CVPR 2023
DUB: Discrete Unit Back-translation for Speech Translation ACL 2023
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning NIPS 2022
Infrared-Visible Cross-Modal Person Re-Identification with an X Modality AAAI 2020
Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrieval CVPR 2018