conftrace_

activation function

133 papers

Explore in graph

Co-occurring keywords

neural network (6616) neural network optimization (1293) deep learning (2118) convolutional neural network (4226) deep neural network (1803) function approximation (319) gradient descent (1144) image classification (1944) neural network architecture (362) model compression (3302)

Papers

Minimal Width for Universal Property of Deep RNN JMLR 2023
Learning Activation Functions for Sparse Neural Networks AUTOML 2023
Learning a Single Neuron for Non-monotonic Activation Functions AISTATS 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks ICML 2022
Towards Understanding the Condensation of Neural Networks at Initial Training NIPS 2022
Logical Activation Functions: Logit-space equivalents of Probabilistic Boolean Operators NIPS 2022
Automatically Gating Multi-Frequency Patterns through Rectified Continuous Bernoulli Units with Theoretical Principles IJCAI 2022
Adaptable Adapters NAACL 2022
Smooth Maximum Unit: Smooth Activation Function for Deep Networks Using Smoothing Maximum Technique CVPR 2022
ErfAct and Pserf: Non-monotonic Smooth Trainable Activation Functions AAAI 2022
Fractional Adaptive Linear Units AAAI 2022
A spectral-based analysis of the separation between two-layer neural networks and linear methods JMLR 2022
Depth separation beyond radial functions JMLR 2022
Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons JMLR 2022
Scaled ReLU Matters for Training Vision Transformers AAAI 2022
Generalization Properties of NAS under Activation and Skip Connection Search NIPS 2022
The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization NIPS 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth NIPS 2022
A Random Matrix Perspective on Mixtures of Nonlinearities in High Dimensions AISTATS 2022
Reverse Engineering the Neural Tangent Kernel ICML 2022
Understanding the Eluder Dimension NIPS 2022
Stochastic Adaptive Activation Function NIPS 2022
Gardner formula for Ising perceptron models at small densities COLT 2022
Coin Flipping Neural Networks ICML 2022
Improving Accuracy of Binary Neural Networks Using Unbalanced Activation Distribution CVPR 2021