Multimodal Learning

Robust Representation Learning by Clustering with Bisimulation Metrics for Visual Reinforcement Learning with Distractions AAAI 2023 Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attention EMNLP 2023 ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense EMNLP 2023 RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control CoRL 2023 Rutgers Multimedia Image Processing Lab at SemEval-2023 Task-1: Text-Augmentation-based Approach for Visual Word Sense Disambiguation SemEval 2023 S3C: Semi-Supervised VQA Natural Language Explanation via Self-Critical Learning CVPR 2023 Scalable 3D Captioning with Pretrained Models NeurIPS 2023 Scalable Performance Analysis for Vision-Language Models ACL 2023 Scaling Language-Image Pre-Training via Masking CVPR 2023 Scaling Laws for Generative Mixed-Modal Language Models ICML 2023 Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition CoRL 2023 Scaling Vision-Language Models with Sparse Mixture of Experts EMNLP 2023 Scaling Vision Transformers to 22 Billion Parameters ICML 2023 SCCS: Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignment ACL 2023 Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination ACL 2023 Scene Graph Enhanced Pseudo-Labeling for Referring Expression Comprehension EMNLP 2023 SceneTrilogy: On Human Scene-Sketch and Its Complementarity With Photo and Text CVPR 2023 SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables EMNLP 2023 S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions NeurIPS 2023 SCOB: Universal Text Understanding via Character-wise Supervised Contrastive Learning with Online Text Rendering for Bridging Domain Gap ICCV 2023 Score-based Data Assimilation NeurIPS 2023 SDNet: Stream-attention and Dual-feature Learning Network for Ad-hoc Array Speech Separation Interspeech 2023 Search-Oriented Conversational Query Editing ACL 2023 See How You Read? Multi-Reading Habits Fusion Reasoning for Multi-Modal Fake News Detection AAAI 2023 "Seeing" Electric Network Frequency From Events CVPR 2023