activation function

Scaling Properties of Deep Residual Networks ICML 2021 Tempered Sigmoid Activations for Deep Learning with Differential Privacy AAAI 2021 Universal approximation power of deep residual neural networks via nonlinear control theory ICLR 2021 Adaptive Activation Network and Functional Regularization for Efficient and Flexible Deep Multi-Task Learning AAAI 2020 Adaptive Convolutional ReLUs AAAI 2020 Agnostic Learning of a Single Neuron with Gradient Descent NeurIPS 2020 BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations ICLR 2020 Cooperative Initialization based Deep Neural Network Training WACV 2020 Differential Equation Units: Learning Functional Forms of Activation Functions from Data AAAI 2020 Effect of Activation Functions on the Training of Overparametrized Neural Nets ICLR 2020 Enhancing Adversarial Defense by k-Winners-Take-All ICLR 2020 Evolving Normalization-Activation Layers NeurIPS 2020 Generating Accurate Pseudo-Labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations CVPR 2020 Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process COLT 2020 Learning a Single Neuron with Gradient Methods COLT 2020 Light Multi-Segment Activation for Model Compression AAAI 2020 L*ReLU: Piece-wise Linear Activation Functions for Deep Fine-grained Visual Categorization WACV 2020 Neural Networks Fail to Learn Periodic Functions and How to Fix It NeurIPS 2020 Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks ICLR 2020 Rational neural networks NeurIPS 2020 Stationary Activations for Uncertainty Calibration in Deep Learning NeurIPS 2020 The phase diagram of approximation rates for deep neural networks NeurIPS 2020 Topology of Deep Neural Networks JMLR 2020 Universal Approximation with Deep Narrow Networks COLT 2020 Wide Hidden Expansion Layer for Deep Convolutional Neural Networks WACV 2020