conftrace_
← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

903 papers

Papers per year

2
9
127
100
'10
'15
'20
'25

Papers

AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023
General Cutting Planes for Bound-Propagation-Based Neural Network Verification NIPS 2022
VectorAdam for Rotation Equivariant Geometry Optimization NIPS 2022
Chaotic Dynamics are Intrinsic to Neural Network Training with SGD NIPS 2022
Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again NIPS 2022
Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization NIPS 2022
Gradient Descent: The Ultimate Optimizer NIPS 2022
A Closer Look at the Adversarial Robustness of Deep Equilibrium Models NIPS 2022
Towards Practical Control of Singular Values of Convolutional Layers NIPS 2022
ZARTS: On Zero-order Optimization for Neural Architecture Search NIPS 2022
Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillations NIPS 2022
Stochastic Adaptive Activation Function NIPS 2022
Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes NIPS 2022
On global convergence of ResNets: From finite to infinite width using linear parameterization NIPS 2022
Towards Theoretically Inspired Neural Initialization Optimization NIPS 2022
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations NIPS 2022
Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs NIPS 2022
An In-depth Study of Stochastic Backpropagation NIPS 2022
To update or not to update? Neurons at equilibrium in deep models NIPS 2022
Differentiable hierarchical and surrogate gradient search for spiking neural networks NIPS 2022
Automatic differentiation of nonsmooth iterative algorithms NIPS 2022
Chaotic Regularization and Heavy-Tailed Limits for Deterministic Gradient Descent NIPS 2022
The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models NIPS 2022
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution NIPS 2022
Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study NIPS 2022