Multimodal Learning

Flexible Biometrics Recognition: Bridging the Multimodality Gap through Attention Alignment and Prompt Tuning CVPR 2024 FT-GAN: Fine-Grained Tune Modeling for Chinese Opera Synthesis AAAI 2024 Functional Graph Convolutional Networks: A Unified Multi-task and Multi-modal Learning Framework to Facilitate Health and Social-Care Insights IJCAI 2024 FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion NeurIPS 2024 Fusion from a Distributional Perspective: A Unified Symbiotic Diffusion Framework for Any Multisource Remote Sensing Data Classification IJCAI 2024 Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyond ACL 2024 Generative Hierarchical Materials Search NeurIPS 2024 GENRA: Enhancing Zero-shot Retrieval with Rank Aggregation EMNLP 2024 GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation EMNLP 2024 GlitchBench: Can Large Multimodal Models Detect Video Game Glitches? CVPR 2024 Gradient-Guided Modality Decoupling for Missing-Modality Robustness AAAI 2024 HEALNet: Multimodal Fusion for Heterogeneous Biomedical Data NeurIPS 2024 Heterogeneous Causal Metapath Graph Neural Network for Gene-Microbe-Disease Association Prediction IJCAI 2024 HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models CVPR 2024 Hierarchical Aligned Multimodal Learning for NER on Tweet Posts AAAI 2024 Holistic Features are almost Sufficient for Text-to-Video Retrieval CVPR 2024 HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative CVPR 2024 Homology Consistency Constrained Efficient Tuning for Vision-Language Models NeurIPS 2024 How Do Conversational Agents in Healthcare Impact on Patient Agency? EACL 2024 How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning? EMNLP 2024 HyDiscGAN: A Hybrid Distributed cGAN for Audio-Visual Privacy Preservation in Multimodal Sentiment Analysis IJCAI 2024 IFCap: Image-like Retrieval and Frequency-based Entity Filtering for Zero-shot Captioning EMNLP 2024 II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Models NeurIPS 2024 II-MMR: Identifying and Improving Multi-modal Multi-hop Reasoning in Visual Question Answering ACL 2024 IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddings SemEval 2024