conftrace_

nonlinearity

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

group partition (1) flops (1) feedforward network (ffn) (1) gelu (1) representation capacity (1) hidden dimension (1) layer normalization (1) vc dimension (1) classification (1) vision transformer (1)

Papers

Enhancing Vision Transformer: Amplifying Non-Linearity in Feedforward Network Module ICML 2024 On the Nonlinearity of Layer Normalization ICML 2024