conftrace_

relu network

143 papers

Explore in graph

Also known as

RELU

Co-occurring keywords

neural network (6616) gradient descent (1144) neural network optimization (1293) gradient flow (142) neural network verification (106) function approximation (319) adversarial robustness (1341) deep neural network (1803) implicit bia (107) generalization bound (652)

Papers

Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data NIPS 2023
Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs NIPS 2023
Learning Narrow One-Hidden-Layer ReLU Networks COLT 2023
On Enhancing Expressive Power via Compositions of Single Fixed-Size ReLU Network ICML 2023
Random Feature Amplification: Feature Learning and Generalization in Neural Networks JMLR 2023
Learning a 1-layer conditional generative model in total variation NIPS 2023
Abide by the law and follow the flow: conservation laws for gradient flows NIPS 2023
From Tempered to Benign Overfitting in ReLU Neural Networks NIPS 2023
Quasi-Equivalence between Width and Depth of Neural Networks JMLR 2023
Investigating how ReLU-networks encode symmetries NIPS 2023
The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks NIPS 2023
Understanding Multi-phase Optimization Dynamics and Rich Nonlinear Behaviors of ReLU Networks NIPS 2023
Adversarial Examples Exist in Two-Layer ReLU Networks for Low Dimensional Linear Subspaces NIPS 2023
Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs NIPS 2023
Maximal Initial Learning Rates in Deep ReLU Networks ICML 2023
Norm-based Generalization Bounds for Sparse Neural Networks NIPS 2023
Ridges, Neural Networks, and the Radon Transform JMLR 2023
Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign? NIPS 2023
Implicit Regularization Towards Rank Minimization in ReLU Networks ALT 2023
Optimal Sets and Solution Paths of ReLU Networks ICML 2023
Model-Based Control with Sparse Neural Dynamics NIPS 2023
The Expressive Power of Tuning Only the Normalization Layers COLT 2023
SmoothHess: ReLU Network Feature Interactions via Stein's Lemma NIPS 2023
Penalising the biases in norm regularisation enforces sparsity NIPS 2023
Deep Network Approximation in Terms of Intrinsic Parameters ICML 2022