next-token prediction

Graph Generative Pre-trained Transformer ICML 2025 GraphGPT: Generative Pre-trained Graph Eulerian Transformer ICML 2025 HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding CVPR 2025 HSI-GPT: A General-Purpose Large Scene-Motion-Language Model for Human Scene Interaction CVPR 2025 Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More ACL 2025 Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More ICML 2025 On the Generalization Ability of Next-Token-Prediction Pretraining ICML 2025 On the Sample Complexity of Next-Token Prediction AISTATS 2025 Overlapping Context with Variable-Length Stride Increases Diversity when Training Large Language Model for Code ACL 2025 PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMs ICCV 2025 Planning-Aware Code Infilling via Horizon-Length Prediction EMNLP 2025 Prediction Hubs are Context-Informed Frequent Tokens in LLMs ACL 2025 Pre-Training Curriculum for Multi-Token Prediction in Language Models ACL 2025 Randomized Autoregressive Visual Generation ICCV 2025 Sequence-level Large Language Model Training with Contrastive Preference Optimization NAACL 2025 The Belief State Transformer ICLR 2025 Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings ICML 2025 Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model ICLR 2025 VocalNet: Speech LLMs with Multi-Token Prediction for Faster and High-Quality Generation EMNLP 2025 What am I missing here?: Evaluating Large Language Models for Masked Sentence Prediction IJCNLP 2025 Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs NeurIPS 2024 Bidirectional Generative Pre-training for Improving Healthcare Time-series Representation Learning MLHC 2024 Differentially Private Next-Token Prediction of Large Language Models NAACL 2024 Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion NeurIPS 2024 Fractal Patterns May Illuminate the Success of Next-Token Prediction NeurIPS 2024