Mohammad Shoeybi

Nemotron-CrossThink: Scaling Self-Learning beyond Math Reasoning EACL 2026 AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling ACL 2025 ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities ICLR 2025 MIND: Math Informed syNthetic Dialogues for Pretraining LLMs ICLR 2025 MM-EMBED: UNIVERSAL MULTIMODAL RETRIEVAL WITH MULTIMODAL LLMS ICLR 2025 Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset ACL 2025 NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models ICLR 2025 ChatQA: Surpassing GPT-4 on Conversational QA and RAG NeurIPS 2024 Compact Language Models via Pruning and Knowledge Distillation NeurIPS 2024 Data, Data Everywhere: A Guide for Pretraining Dataset Construction EMNLP 2024 InstructRetro: Instruction Tuning post Retrieval-Augmented Pretraining ICML 2024 LLM-Evolve: Evaluation for LLM’s Evolving Capability on Benchmarks EMNLP 2024 ODIN: Disentangled Reward Mitigates Hacking in RLHF ICML 2024 RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs NeurIPS 2024 Retrieval meets Long Context Large Language Models ICLR 2024 VILA: On Pre-training for Visual Language Models CVPR 2024 Adding Instructions during Pretraining: Effective way of Controlling Toxicity in Language Models EACL 2023 Context Generation Improves Open Domain Question Answering EACL 2023 Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning EMNLP 2023 Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study EMNLP 2023 Evaluating Parameter Efficient Learning for Generation EMNLP 2022 Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models NeurIPS 2022 Factuality Enhanced Language Models for Open-Ended Text Generation NeurIPS 2022 Multi-Stage Prompting for Knowledgeable Dialogue Generation ACL 2022 Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models EMNLP 2022 End-to-End Training of Neural Retrievers for Open-Domain Question Answering ACL 2021 Long-Short Transformer: Efficient Transformers for Language and Vision NeurIPS 2021 BioMegatron: Larger Biomedical Domain Language Model EMNLP 2020 Large Scale Multi-Actor Generative Dialog Modeling ACL 2020 MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models EMNLP 2020 Training Question Answering Models From Synthetic Data EMNLP 2020 Unsupervised Video Interpolation Using Cycle Consistency ICCV 2019 Deep Voice: Real-time Neural Text-to-Speech ICML 2017