conftrace_

pretraining dynamics

11 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (4) knowledge acquisition (2) linguistic knowledge (2) probing analysis (2) factual knowledge (2) in-context learning (2) factual knowledge acquisition (1) knowledge forgetting (1) batch size effect (1) model reliability (1)

Papers

Crosscoding Through Time: Tracking Emergence & Consolidation Of Linguistic Representations Throughout LLM Pretraining ACL 2026 Investigating the Pre-Training Dynamics of In-Context Learning: Task Recognition vs. Task Learning ICLR 2025 Language Models “Grok” to Copy NAACL 2025 Language Models Grow Less Humanlike beyond Phase Transition ACL 2025 MosaicDiff: Training-free Structural Pruning for Diffusion Model Acceleration Reflecting Pretraining Dynamics ICCV 2025 Temporal Scaling Law for Large Language Models EMNLP 2025 How Do Large Language Models Acquire Factual Knowledge During Pretraining? NeurIPS 2024 Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models ACL 2024 Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models EMNLP 2022 Probing Across Time: What Does RoBERTa Know and When? EMNLP 2021 Pretrained Language Model Embryology: The Birth of ALBERT EMNLP 2020