conftrace_

batch size effect

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

batch size (1) knowledge memorization (1) large language model (1) factual knowledge acquisition (1) pretraining dynamics (1) knowledge forgetting (1) knowledge generalization (1) factual knowledge (1)

Papers

How Do Large Language Models Acquire Factual Knowledge During Pretraining? NeurIPS 2024