gradient grouping

large language model (1) adaptive optimizer (1) gradient clustering (1) learning rate estimation (1) training instability (1) convergence speed (1) parameter-efficient fine-tuning (1) learning rate (1)