Skip to content
conftrace_

pre-training distribution

4 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) in-context learning (2) alignment fine-tuning (1) model elasticity (1) harmful output mitigation (1) finite sample complexity (1) pretraining phase (1) in-context generation (1) pretrained corpus (1) elastic collapse (1)

Papers

Language Models Resist Alignment: Evidence From Data Compression ACL 2025 Get more for less: Principled Data Selection for Warming Up Fine-Tuning in LLMs ICLR 2024 On the In-context Generation of Language Models EMNLP 2024 The Learnability of In-Context Learning NeurIPS 2023