Skip to content
conftrace_

swish activation

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

activation function (3) neural network optimization (2) non-monotonic activation (1) adaptive activation (1) single neuron (1) deep neural network (1) long short-term memory (1) polynomial time (1) gradient descent (1) deep learning (1)

Papers

Learning a Single Neuron for Non-monotonic Activation Functions AISTATS 2022 Stochastic Adaptive Activation Function NeurIPS 2022 Is it Time to Swish? Comparing Deep Learning Activation Functions Across NLP tasks EMNLP 2018