relu activation

Norm-based Generalization Bounds for Sparse Neural Networks NeurIPS 2023 Optimal Approximation Rates for Deep ReLU Neural Networks on Sobolev and Besov Spaces JMLR 2023 Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron COLT 2023 Robustly Learning a Single Neuron via Sharpness ICML 2023 Training Neural Networks is NP-Hard in Fixed Dimension NeurIPS 2023 A Complete Characterisation of ReLU-Invariant Distributions AISTATS 2022 A global convergence theory for deep ReLU implicit networks via over-parameterization ICLR 2022 A NON-PARAMETRIC REGRESSION VIEWPOINT : GENERALIZATION OF OVERPARAMETRIZED DEEP RELU NETWORK UNDER NOISY OBSERVATIONS ICLR 2022 A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions JMLR 2022 Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions NeurIPS 2022 Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness ICML 2022 Local Identifiability of Deep ReLU Neural Networks: the Theory NeurIPS 2022 Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time AISTATS 2022 Neural Network Approximation based on Hausdorff distance of Tropical Zonotopes ICLR 2022 Neural Network Architecture Beyond Width and Depth NeurIPS 2022 Selective Network Linearization for Efficient Private Inference ICML 2022 SQ Lower Bounds for Learning Single Neurons with Massart Noise NeurIPS 2022 Theoretical analysis of deep neural networks for temporally dependent observations NeurIPS 2022 Tighter Sparse Approximation Bounds for ReLU Neural Networks ICLR 2022 Training Two-Layer ReLU Networks with Gradient Descent is Inconsistent JMLR 2022 Understanding Non-linearity in Graph Neural Networks from the Bayesian-Inference Perspective NeurIPS 2022 A Convergence Analysis of Gradient Descent on Graph Neural Networks NeurIPS 2021 A single gradient step finds adversarial examples on random two-layers neural networks NeurIPS 2021 Deep Equals Shallow for ReLU Networks in Kernel Regimes ICLR 2021 DeepReDuce: ReLU Reduction for Fast Private Inference ICML 2021