Multimodal Learning

Omnipotent Distillation with LLMs for Weakly-Supervised Natural Language Video Localization: When Divergence Meets Consistency AAAI 2024 OmniVec: Learning Robust Representations With Cross Modal Sharing WACV 2024 OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning CVPR 2024 On the Comparison between Multi-modal and Single-modal Contrastive Learning NeurIPS 2024 OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments NeurIPS 2024 OxonFair: A Flexible Toolkit for Algorithmic Fairness NeurIPS 2024 Pelican: Correcting Hallucination in Vision-LLMs via Claim Decomposition and Program of Thought Verification EMNLP 2024 Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformers NeurIPS 2024 Polos: Multimodal Metric Learning from Human Feedback for Image Captioning CVPR 2024 Posture-Informed Muscular Force Learning for Robust Hand Pressure Estimation NeurIPS 2024 PreAlign: Boosting Cross-Lingual Transfer by Early Establishment of Multilingual Alignment EMNLP 2024 Probabilistic Federated Prompt-Tuning with Non-IID and Imbalanced Data NeurIPS 2024 Prompt-Driven Referring Image Segmentation with Instance Contrasting CVPR 2024 Prompt-enhanced Network for Hateful Meme Classification IJCAI 2024 Prot2Text: Multimodal Protein’s Function Generation with GNNs and Transformers AAAI 2024 Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignment AAAI 2024 Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval EMNLP 2024 Question Aware Vision Transformer for Multimodal Reasoning CVPR 2024 Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels CVPR 2024 RecomMind: Movie Recommendation Dialogue with Seeker’s Internal State EMNLP 2024 RedCore: Relative Advantage Aware Cross-Modal Representation Learning for Missing Modalities with Imbalanced Missing Rates AAAI 2024 RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding CVPR 2024 Relational Programming with Foundational Models AAAI 2024 RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method CVPR 2024 Reliable Conflictive Multi-View Learning AAAI 2024