conftrace_

relu network

143 papers

Explore in graph

Also known as

RELU

Co-occurring keywords

neural network (6616) gradient descent (1144) neural network optimization (1293) gradient flow (142) neural network verification (106) function approximation (319) adversarial robustness (1341) deep neural network (1803) implicit bia (107) generalization bound (652)

Papers

The Separation Capacity of Random Neural Networks JMLR 2022
Understanding the Evolution of Linear Regions in Deep Reinforcement Learning NIPS 2022
Path-BN: Towards effective batch normalization in the Path Space for ReLU networks UAI 2021
DEEPSPLIT: An Efficient Splitting Method for Neural Network Verification via Indirect Effect Analysis IJCAI 2021
On the Random Conjugate Kernel and Neural Tangent Kernel ICML 2021
FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Analysis ICML 2021
A Modular Analysis of Provable Acceleration via Polyak’s Momentum: Training a Wide ReLU Network and a Deep Linear Network ICML 2021
Global Optimality Beyond Two Layers: Training Deep ReLU Networks via Convex Programs ICML 2021
Early-stopped neural networks are consistent NIPS 2021
The Implicit Bias of Minima Stability: A View from Function Space NIPS 2021
Adversarial Examples in Multi-Layer Random ReLU Networks NIPS 2021
Size and Depth Separation in Approximating Benign Functions with Neural Networks COLT 2021
Approximating Lipschitz continuous functions with GroupSort neural networks AISTATS 2021
Revealing the Structure of Deep Neural Networks via Convex Duality ICML 2021
On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths ICML 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning ICML 2021
Exact marginal prior distributions of finite Bayesian neural networks NIPS 2021
An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence NIPS 2021
Efficiently Learning One Hidden Layer ReLU Networks From Queries NIPS 2021
Precise characterization of the prior predictive distribution of deep ReLU networks NIPS 2021
On the Approximation Power of Two-Layer Networks of Random ReLUs COLT 2021
Implicit Regularization in ReLU Networks with the Square Loss COLT 2021
From Local Pseudorandom Generators to Hardness of Learning COLT 2021
The Effects of Mild Over-parameterization on the Optimization Landscape of Shallow ReLU Neural Networks COLT 2021
Most ReLU Networks Suffer from $\ell^2$ Adversarial Perturbations NIPS 2020