Skip to content
conftrace_

scaled relu

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

training stabilization (1) convolution stem (1) patch token (1) activation function (1) parameter optimization (1) neural network training (1) vision transformer (1)

Papers

Scaled ReLU Matters for Training Vision Transformers AAAI 2022