Multimodal Learning

From Text to Trajectory: Exploring Complex Constraint Representation and Decomposition in Safe Reinforcement Learning NeurIPS 2024 From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis EMNLP 2024 From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generation ICML 2024 Frozen Transformers in Language Models Are Effective Visual Encoder Layers ICLR 2024 FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance Head-pose and Facial Expression Features CVPR 2024 Full-Atom Peptide Design based on Multi-modal Flow Matching ICML 2024 Functional Graph Convolutional Networks: A Unified Multi-task and Multi-modal Learning Framework to Facilitate Health and Social-Care Insights IJCAI 2024 FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions WACV 2024 FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion NeurIPS 2024 Fusion-Eval: Integrating Assistant Evaluators with LLMs EMNLP 2024 FusionFormer: A Concise Unified Feature Fusion Transformer for 3D Pose Estimation AAAI 2024 Fusion from a Distributional Perspective: A Unified Symbiotic Diffusion Framework for Any Multisource Remote Sensing Data Classification IJCAI 2024 Fusion Is Not Enough: Single Modal Attacks on Fusion Models for 3D Object Detection ICLR 2024 Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering NAACL 2024 G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training NeurIPS 2024 G^2SAM: Graph-Based Global Semantic Awareness Method for Multimodal Sarcasm Detection AAAI 2024 G3: An Effective and Adaptive Framework for Worldwide Geolocalization Using Large Multi-Modality Models NeurIPS 2024 G^3-LQ: Marrying Hyperbolic Alignment with Explicit Semantic-Geometric Modeling for 3D Visual Grounding CVPR 2024 GAIA: Rethinking Action Quality Assessment for AI-Generated Videos NeurIPS 2024 GAINER: Graph Machine Learning with Node-specific Radius for Classification of Short Texts and Documents EACL 2024 GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting ICML 2024 GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities EMNLP 2024 Game on Tree: Visual Hallucination Mitigation via Coarse-to-Fine View Tree and Game Theory EMNLP 2024 Gemini Goes to Med School: Exploring the Capabilities of Multimodal Large Language Models on Medical Challenge Problems & Hallucinations NAACL 2024 GenAI Arena: An Open Evaluation Platform for Generative Models NeurIPS 2024