activation function

ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024 The effect of Leaky ReLUs on the training and generalization of overparameterized networks AISTATS 2024 The Evidence Contraction Issue in Deep Evidential Regression: Discussion and Solution AAAI 2024 What does automatic differentiation compute for neural networks? ICLR 2024 Achieve the Minimum Width of Neural Networks for Universal Approximation ICLR 2023 A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing Rates ICML 2023 AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks AAAI 2023 Can CNNs Be More Robust Than Transformers? ICLR 2023 Constrained Monotonic Neural Networks ICML 2023 Efficient Activation Function Optimization through Surrogate Modeling NeurIPS 2023 Efficient Global Robustness Certification of Neural Networks via Interleaving Twin-Network Encoding (Extended Abstract) IJCAI 2023 Empowering Convolutional Neural Nets with MetaSin Activation NeurIPS 2023 Few-bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction ICML 2023 IIEU: Rethinking Neural Feature Activation from Decision-Making ICCV 2023 Learning Activation Functions for Sparse Neural Networks AutoML 2023 Lon-eå at SemEval-2023 Task 11: A Comparison of Activation Functions for Soft and Hard Label Prediction SemEval 2023 Minimal Width for Universal Property of Deep RNN JMLR 2023 Most Neural Networks Are Almost Learnable NeurIPS 2023 New Complexity-Theoretic Frontiers of Tractability for Neural Network Training NeurIPS 2023 On the impact of activation and normalization in obtaining isometric embeddings at initialization NeurIPS 2023 Optimal Activation Functions for the Random Features Regression Model ICLR 2023 Optimal approximation using complex-valued neural networks NeurIPS 2023 Optimal Nonlinearities Improve Generalization Performance of Random Features ACML 2023 SERF: Towards Better Training of Deep Neural Networks Using Log-Softplus ERror Activation Function WACV 2023 SOL: Sampling-based Optimal Linear bounding of arbitrary scalar functions NeurIPS 2023