modality fusion

AlterMOMA: Fusion Redundancy Pruning for Camera-LiDAR Fusion Models with Alternative Modality Masking NeurIPS 2024 AVCap: Leveraging Audio-Visual Features as Text Tokens for Captioning Interspeech 2024 Beyond Fusion: Modality Hallucination-Based Multispectral Fusion for Pedestrian Detection WACV 2024 CARAT: Contrastive Feature Reconstruction and Aggregation for Multi-Modal Multi-Label Emotion Recognition AAAI 2024 Dissecting Multimodality in VideoQA Transformer Models by Impairing Modality Fusion ICML 2024 Enhancing Modal Fusion by Alignment and Label Matching for Multimodal Emotion Recognition Interspeech 2024 Knowledge-Guided Dynamic Modality Attention Fusion Framework for Multimodal Sentiment Analysis EMNLP 2024 Multi-Modal Sarcasm Detection Based on Dual Generative Processes IJCAI 2024 SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking CVPR 2024 Self-Powered LLM Modality Expansion for Large Speech-Text Models EMNLP 2024 Single-Model and Any-Modality for Video Object Tracking CVPR 2024 Temporal Adaptive RGBT Tracking with Modality Prompt AAAI 2024 Unified Single-Stage Transformer Network for Efficient RGB-T Tracking IJCAI 2024 Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion COLING 2024 xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token NeurIPS 2024 Decoupled Multimodal Distilling for Emotion Recognition CVPR 2023 Efficient RGB-T Tracking via Cross-Modality Distillation CVPR 2023 Encoder-decoder Multimodal Speaker Change Detection Interspeech 2023 Hierarchical Adaptive Value Estimation for Multi-modal Visual Reinforcement Learning NeurIPS 2023 Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimoda Emotion Recognition EMNLP 2023 Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding Interspeech 2023 Modality Mixer for Multi-Modal Action Recognition WACV 2023 Are Multimodal Transformers Robust to Missing Modality? CVPR 2022 Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos CVPR 2022 M-SENA: An Integrated Platform for Multimodal Sentiment Analysis ACL 2022