conftrace_

relu activation

93 papers

Explore in graph

Also known as

RELU

Co-occurring keywords

neural network (6616) gradient descent (1144) learning theory (519) relu network (143) neural network optimization (1293) deep neural network (1803) rectified linear unit (24) neural network training (309) single neuron (11) generalization bound (652)

Papers

Inverting Deep Generative models, One layer at a time NIPS 2019
On Learning Over-parameterized Neural Networks: A Functional Approximation Perspective NIPS 2019
Piecewise Strong Convexity of Neural Networks NIPS 2019
Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity NIPS 2019
Complexity of Linear Regions in Deep Networks ICML 2019
A Convergence Theory for Deep Learning via Over-Parameterization ICML 2019
Nearly-tight VC-dimension and Pseudodimension Bounds for Piecewise Linear Neural Networks JMLR 2019
Capacity Control of ReLU Neural Networks by Basis-Path Norm AAAI 2019
Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Corrections NIPS 2018
Invariance of Weight Distributions in Rectified MLPs ICML 2018
Which Neural Net Architectures Give Rise to Exploding and Vanishing Gradients? NIPS 2018
Diverse Neural Network Learns True Target Functions AISTATS 2017
Revisit Fuzzy Neural Network: Demystifying Batch Normalization and ReLU with Generalized Hamming Network NIPS 2017
Net-Trim: Convex Pruning of Deep Neural Networks with Performance Guarantee NIPS 2017
Learning ReLUs via Gradient Descent NIPS 2017
Convergence Analysis of Two-layer Neural Networks with ReLU Activation NIPS 2017
Convergent Block Coordinate Descent for Training Tikhonov Regularized Deep Neural Networks NIPS 2017
Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations NIPS 2016