conftrace_

next-token prediction

34 papers

Explore in graph

Also known as

NTP

Co-occurring keywords

large language model (13587) representation learning (6206) language model (4599) in-context learning (1405) autoregressive model (456) few-shot learning (3398) discrete tokenization (8) linguistic competence (11) teacher forcing (27) neural network (6616)

Papers

Many-Shot In-Context Learning NIPS 2024
The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains NIPS 2024
Fractal Patterns May Illuminate the Success of Next-Token Prediction NIPS 2024
The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More NIPS 2024
SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Prediction NIPS 2024
Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs NIPS 2024
Differentially Private Next-Token Prediction of Large Language Models NAACL 2024
Local to Global: Learning Dynamics and Effect of Initialization for Transformers NIPS 2024
Token Prediction as Implicit Classification to Identify LLM-Generated Text EMNLP 2023