conftrace_

next-token prediction

34 papers

Explore in graph

Also known as

NTP

Co-occurring keywords

large language model (13587) representation learning (6206) language model (4599) in-context learning (1405) autoregressive model (456) few-shot learning (3398) discrete tokenization (8) linguistic competence (11) teacher forcing (27) neural network (6616)

Papers

Gap-K%: Measuring Top-1 Prediction Gap for Detecting Pretraining Data ACL 2026
Language Models Struggle to Use Representations Learned In-Context ACL 2026
Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks ACL 2026
Reinforcement Learning on Pre-Training Data ACL 2026
PPGPT: Transferring Next-Token Modeling from Language to PPG Signals AAAI 2026
Beyond Tokens: Concept-Level Training Objectives for LLMs EACL 2026
Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generation ICCV 2025
HSI-GPT: A General-Purpose Large Scene-Motion-Language Model for Human Scene Interaction CVPR 2025
Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More ACL 2025
PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMs ICCV 2025
Randomized Autoregressive Visual Generation ICCV 2025
Generating Physically Stable and Buildable Brick Structures from Text ICCV 2025
VocalNet: Speech LLMs with Multi-Token Prediction for Faster and High-Quality Generation EMNLP 2025
From Language to Cognition: How LLMs Outgrow the Human Language Network EMNLP 2025
Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM’s Nest ACL 2025
A rebuttal of two common deflationary stances against LLM cognition ACL 2025
Planning-Aware Code Infilling via Horizon-Length Prediction EMNLP 2025
Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion NIPS 2024
Non-asymptotic Convergence of Training Transformers for Next-token Prediction NIPS 2024
The Mystery of the Pathological Path-star Task for Language Models EMNLP 2024
Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions EMNLP 2024
Semformer: Transformer Language Models with Semantic Planning EMNLP 2024
Towards a theory of how the structure of language is acquired by deep neural networks NIPS 2024
Implicit Optimization Bias of Next-token Prediction in Linear Models NIPS 2024
Transformers Represent Belief State Geometry in their Residual Stream NIPS 2024