conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,649 papers

Papers per year

2
5
40
414
386
'05
'10
'15
'20
'25

Papers

Train simultaneously, generalize better: Stability of gradient-based minimax learners ICML 2021
Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise ICML 2021
On Proximal Policy Optimization’s Heavy-tailed Gradients ICML 2021
Spectral Normalisation for Deep Reinforcement Learning: An Optimisation Perspective ICML 2021
The Heavy-Tail Phenomenon in SGD ICML 2021
Improving Molecular Graph Neural Network Explainability with Orthonormalization and Induced Sparsity ICML 2021
Distributed Second Order Methods with Fast Rates and Compressed Communication ICML 2021
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization ICML 2021
Fast margin maximization via dual acceleration ICML 2021
Approximation Theory of Convolutional Architectures for Time Series Modelling ICML 2021
On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models ICML 2021
Training Recurrent Neural Networks via Forward Propagation Through Time ICML 2021
Affine Invariant Analysis of Frank-Wolfe on Strongly Convex Sets ICML 2021
"Hey, that’s not an ODE": Faster ODE Adjoints via Seminorms ICML 2021
The Lipschitz Constant of Self-Attention ICML 2021
Improved, Deterministic Smoothing for L_1 Certified Robustness ICML 2021
PAGE: A Simple and Optimal Probabilistic Gradient Estimator for Nonconvex Optimization ICML 2021
A Novel Method to Solve Neural Knapsack Problems ICML 2021
A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and Performance ICML 2021
Debiasing a First-order Heuristic for Approximate Bi-level Optimization ICML 2021
Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generation ICML 2021
Quasi-global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data ICML 2021
Learning by Turning: Neural Architecture Aware Optimisation ICML 2021
Selfish Sparse RNN Training ICML 2021
Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not? ICML 2021