relu activation

Efficient Algorithms for Learning Depth-2 Neural Networks with General ReLU Activations NeurIPS 2021 Efficiently Learning One Hidden Layer ReLU Networks From Queries NeurIPS 2021 How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks ICLR 2021 Implicit Convex Regularizers of CNN Architectures: Convex Optimization of Two- and Three-Layer Networks in Polynomial Time ICLR 2021 Learning a Single Neuron with Bias Using Gradient Descent NeurIPS 2021 Minimum Width for Universal Approximation ICLR 2021 Numerical influence of ReLU’(0) on backpropagation NeurIPS 2021 On Learnability via Gradient Method for Two-Layer ReLU Neural Networks in Teacher-Student Setting ICML 2021 On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models ICML 2021 Ringing ReLUs: Harmonic Distortion Analysis of Nonlinear Feedforward Networks ICLR 2021 Robust Learning for Data Poisoning Attacks ICML 2021 Sparsifying Networks via Subdifferential Inclusion ICML 2021 Towards Lower Bounds on the Depth of ReLU Neural Networks NeurIPS 2021 TropEx: An Algorithm for Extracting Linear Terms in Deep Neural Networks ICLR 2021 When does gradient descent with logistic loss interpolate using deep networks with smoothed ReLU activations? COLT 2021 Zhestyatsky at SemEval-2021 Task 2: ReLU over Cosine Similarity for BERT Fine-tuning SemEval 2021 Agnostic Learning of a Single Neuron with Gradient Descent NeurIPS 2020 Bounds on Over-Parameterization for Guaranteed Existence of Descent Paths in Shallow ReLU Networks ICLR 2020 Branch and Bound for Piecewise Linear Neural Network Verification JMLR 2020 CryptoNAS: Private Inference on a ReLU Budget NeurIPS 2020 Efficient Verification of ReLU-Based Neural Networks via Dependency Analysis AAAI 2020 Learning Over-Parametrized Two-Layer Neural Networks beyond NTK COLT 2020 Linear predictor on linearly-generated data with missing values: non consistency and solutions AISTATS 2020 Near-Optimal SQ Lower Bounds for Agnostically Learning Halfspaces and ReLUs under Gaussian Marginals NeurIPS 2020 Network size and size of the weights in memorization with two-layers neural networks NeurIPS 2020