conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,648 papers

Papers per year

Papers

An Initial Alignment between Neural Network and Target is Needed for Gradient Descent to Learn ICML 2022
Deep equilibrium networks are sensitive to initialization statistics ICML 2022
Understanding the unstable convergence of gradient descent ICML 2022
A Natural Actor-Critic Framework for Zero-Sum Markov Games ICML 2022
Towards Understanding Sharpness-Aware Minimization ICML 2022
Understanding Gradient Descent on the Edge of Stability in Deep Learning ICML 2022
Certified Neural Network Watermarks with Randomized Smoothing ICML 2022
Gradient Descent on Neurons and its Link to Approximate Second-order Optimization ICML 2022
How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective ICML 2022
Convolutional and Residual Networks Provably Contain Lottery Tickets ICML 2022
On Non-local Convergence Analysis of Deep Linear Networks ICML 2022
Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness ICML 2022
MAML and ANIL Provably Learn Representations ICML 2022
Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass ICML 2022
Learning General Halfspaces with Adversarial Label Noise via Online Gradient Descent ICML 2022
Towards Scaling Difference Target Propagation by Learning Backprop Targets ICML 2022
(Non-)Convergence Results for Predictive Coding Networks ICML 2022
Large-Scale Graph Neural Architecture Search ICML 2022
Implicit Regularization with Polynomial Growth in Deep Tensor Factorization ICML 2022
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers ICML 2022
Transformer Quality in Linear Time ICML 2022
Training Your Sparse Neural Network Better with Any Mask ICML 2022
Towards understanding how momentum improves generalization in deep learning ICML 2022
Matching Learned Causal Effects of Neural Networks with Domain Priors ICML 2022
Fisher SAM: Information Geometry and Sharpness Aware Minimisation ICML 2022