Skip to content
conftrace_

training stabilization

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

scaled relu (1) convolution stem (1) patch token (1) activation function (1) parameter optimization (1) neural network training (1) vision transformer (1)

Papers

Scaled ReLU Matters for Training Vision Transformers AAAI 2022