conftrace_

gelu

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

feedforward network (ffn) (1) approximate backpropagation (1) memory-sharing backpropagation (1) silu (1) flops (1) nonlinearity (1) relu (1) hidden dimension (1) layer normalization (1) vision transformer (1)

Papers

Enhancing Vision Transformer: Amplifying Non-Linearity in Feedforward Network Module ICML 2024 Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation ICML 2024