multi-task pretraining

SoccerMaster: A Vision Foundation Model for Soccer Understanding CVPR 2026 Argus: A Compact and Versatile Foundation Model for Vision CVPR 2025 CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models ICML 2025 EgoM2P: Egocentric Multimodal Multitask Pretraining ICCV 2025 HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding AAAI 2025 SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Training AAAI 2025 You are an LLM teaching a smaller model everything you know: Multi-task pretraining of language models with LLM-designed study plans EMNLP 2025 Instruction Pre-Training: Language Models are Supervised Multitask Learners EMNLP 2024 PIGEON: Predicting Image Geolocations CVPR 2024 Active representation learning for general task space with applications in robotics NeurIPS 2023 Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning ACL 2023 Multitask Pretraining with Structured Knowledge for Text-to-SQL Generation ACL 2023 On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning ICLR 2023 UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization ACL 2023 Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System ACL 2022 On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learning NeurIPS 2022 Sound and Visual Representation Learning With Multiple Pretraining Tasks CVPR 2022 Task Compass: Scaling Multi-task Pre-training with Task Prefix EMNLP 2022 ZeroPrompt: Scaling Prompt-Based Pretraining to 1,000 Tasks Improves Zero-Shot Generalization EMNLP 2022 Improving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment EMNLP 2021 M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-Training CVPR 2021 Masking Orchestration: Multi-Task Pretraining for Multi-Role Dialogue Representation Learning AAAI 2020 On Losses for Modern Language Models EMNLP 2020