conftrace_

activation function

133 papers

Explore in graph

Co-occurring keywords

neural network (6616) neural network optimization (1293) deep learning (2118) convolutional neural network (4226) deep neural network (1803) function approximation (319) gradient descent (1144) image classification (1944) neural network architecture (362) model compression (3302)

Papers

Adaptive Convolutional ReLUs AAAI 2020
Evolving Normalization-Activation Layers NIPS 2020
Universal Approximation with Deep Narrow Networks COLT 2020
Wide Hidden Expansion Layer for Deep Convolutional Neural Networks WACV 2020
Differential Equation Units: Learning Functional Forms of Activation Functions from Data AAAI 2020
Generating Accurate Pseudo-Labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations CVPR 2020
Learning in the Machine: Random Backpropagation and the Deep Learning Channel (Extended Abstract) IJCAI 2019
Lifted Proximal Operator Machines AAAI 2019
Towards Non-Saturating Recurrent Units for Modelling Long-Term Dependencies AAAI 2019
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup NIPS 2019
Fast Image Restoration With Multi-Bin Trainable Linear Units ICCV 2019
A Representer Theorem for Deep Neural Networks JMLR 2019
On the Impact of the Activation function on Deep Neural Networks Training ICML 2019
Tight Sample Complexity of Learning One-hidden-layer Convolutional Neural Networks NIPS 2019
Neural Networks Should Be Wide Enough to Learn Disconnected Decision Regions ICML 2018
Breaking the Activation Function Bottleneck through Adaptive Parameterization NIPS 2018
Is it Time to Swish? Comparing Deep Learning Activation Functions Across NLP tasks EMNLP 2018
Gaussian Process Neural Networks for Speech Recognition INTERSPEECH 2018
Efficient Neural Network Robustness Certification with General Activation Functions NIPS 2018
xUnit: Learning a Spatial Activation Function for Efficient Image Restoration CVPR 2018
Deep Activation Mixture Model for Speech Recognition INTERSPEECH 2017
Self-Normalizing Neural Networks NIPS 2017
On the Complexity of Learning Neural Networks NIPS 2017
A Probabilistic Framework for Nonlinearities in Stochastic Neural Networks NIPS 2017
Diverse Neuron Type Selection for Convolutional Neural Networks IJCAI 2017