conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning NIPS 2022
Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules NIPS 2022
Surprising Instabilities in Training Deep Networks and a Theoretical Analysis NIPS 2022
Towards Theoretically Inspired Neural Initialization Optimization NIPS 2022
Biologically-plausible backpropagation through arbitrary timespans via local neuromodulators NIPS 2022
Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials NIPS 2022
Learning Distributions Generated by Single-Layer ReLU Networks in the Presence of Arbitrary Outliers NIPS 2022
Analyzing Sharpness along GD Trajectory: Progressive Sharpening and Edge of Stability NIPS 2022
AdaLoss: A Computationally-Efficient and Provably Convergent Adaptive Gradient Method AAAI 2022
Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization NIPS 2022
Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures NIPS 2022
Complex Momentum for Optimization in Games AISTATS 2022
Pareto navigation gradient descent: a first-order algorithm for optimization in pareto set UAI 2022
A Simple Guard for Learned Optimizers ICML 2022
Learning from Mistakes – a Framework for Neural Architecture Search AAAI 2022
Optimization-Based Separations for Neural Networks COLT 2022
Learning in Stochastic Monotone Games with Decision-Dependent Data AISTATS 2022
Training Two-Layer ReLU Networks with Gradient Descent is Inconsistent JMLR 2022
Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Models NIPS 2022
The First Optimal Algorithm for Smooth and Strongly-Convex-Strongly-Concave Minimax Optimization NIPS 2022
Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition NIPS 2022
Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems JMLR 2022
Gradient Descent: The Ultimate Optimizer NIPS 2022
Overparameterization of Deep ResNet: Zero Loss and Mean-field Analysis JMLR 2022
Local and Global Convergence of General Burer-Monteiro Tensor Optimizations AAAI 2022