conftrace_

loss spike

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

weight scaling (1) large language model (1) parameter initialization (1) weight initialization (1) neural network optimization (1)

Papers

Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes EMNLP 2024