Skip to content
conftrace_

preconditioning optimizer

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

outlier feature (1) activation normalization (1) transformer training (1) neural network optimization (1) model quantization (1) transformer architecture (1) model compression (1)

Papers

Understanding and Minimising Outlier Features in Transformer Training NeurIPS 2024