conftrace_

pretraining dynamics

7 papers

Explore in graph

Co-occurring keywords

large language model (13587) sampling acceleration (12) pretrained language model (1030) batch size (34) multilingual model (925) linguistic representation (22) multilingual language model (444) world knowledge (73) language model pretraining (105) knowledge memorization (17)

Papers

Crosscoding Through Time: Tracking Emergence & Consolidation Of Linguistic Representations Throughout LLM Pretraining ACL 2026
Language Models Grow Less Humanlike beyond Phase Transition ACL 2025
MosaicDiff: Training-free Structural Pruning for Diffusion Model Acceleration Reflecting Pretraining Dynamics ICCV 2025
Temporal Scaling Law for Large Language Models EMNLP 2025
How Do Large Language Models Acquire Factual Knowledge During Pretraining? NIPS 2024
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models EMNLP 2022
Pretrained Language Model Embryology: The Birth of ALBERT EMNLP 2020