Multimodal Learning

Satyrn: A Platform for Analytics Augmented Generation EMNLP 2024 Say Anything with Any Style AAAI 2024 SBAAM! Eliminating Transcript Dependency in Automatic Subtitling ACL 2024 Scalable Pre-training of Large Autoregressive Image Models ICML 2024 Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviation CoRL 2024 ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenes WACV 2024 ScanERU: Interactive 3D Visual Grounding Based on Embodied Reference Understanding AAAI 2024 ScanFormer: Referring Expression Comprehension by Iteratively Scanning CVPR 2024 SCANNER: Knowledge-Enhanced Approach for Robust Multi-modal Named Entity Recognition of Unseen Entities NAACL 2024 SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark ACL 2024 Scene-adaptive and Region-aware Multi-modal Prompt for Open Vocabulary Object Detection CVPR 2024 SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout NeurIPS 2024 Scene Graph Generation with Role-Playing Large Language Models NeurIPS 2024 SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos ICLR 2024 SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinement EMNLP 2024 SciDQA: A Deep Reading Comprehension Dataset over Scientific Papers EMNLP 2024 SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation NeurIPS 2024 SciMind: A Multimodal Mixture-of-Experts Model for Advancing Pharmaceutical Sciences ACL 2024 SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval ACL 2024 SciMRC: Multi-perspective Scientific Machine Reading Comprehension COLING 2024 SciOL and MuLMS-Img: Introducing a Large-Scale Multimodal Scientific Dataset and Models for Image-Text Tasks in the Scientific Domain WACV 2024 SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions EMNLP 2024 Score Distillation via Reparametrized DDIM NeurIPS 2024 SCO-VIST: Social Interaction Commonsense Knowledge-based Visual Storytelling EACL 2024 ScreenAgent: A Vision Language Model-driven Computer Control Agent IJCAI 2024