gradient descent

Anticorrelated Noise Injection for Improved Generalization ICML 2022 A Parametric Class of Approximate Gradient Updates for Policy Optimization ICML 2022 A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions JMLR 2022 A Simple Guard for Learned Optimizers ICML 2022 A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization ICML 2022 A Solver + Gradient Descent Training Algorithm for Deep Neural Networks IJCAI 2022 A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features ICLR 2022 AutoLoss-Zero: Searching Loss Functions From Scratch for Generic Tasks CVPR 2022 Benign Overfitting in Two-layer Convolutional Neural Networks NeurIPS 2022 Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data COLT 2022 Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules NeurIPS 2022 Biologically-plausible backpropagation through arbitrary timespans via local neuromodulators NeurIPS 2022 Breaking the Convergence Barrier: Optimization via Fixed-Time Convergent Flows AAAI 2022 Chaotic Regularization and Heavy-Tailed Limits for Deterministic Gradient Descent NeurIPS 2022 COLA: Consistent Learning with Opponent-Learning Awareness ICML 2022 Complex Momentum for Optimization in Games AISTATS 2022 Constrained Gradient Descent: A Powerful and Principled Evasion Attack Against Neural Networks ICML 2022 Contextual Gradient Scaling for Few-Shot Learning WACV 2022 Continual learning: a feature extraction formalization, an efficient algorithm, and fundamental obstructions NeurIPS 2022 Continual Learning with Recursive Gradient Optimization ICLR 2022 Convergence of Feedback Arc Set-Based Heuristics for Linear Structural Equation Models PGM 2022 Convex Analysis of the Mean Field Langevin Dynamics AISTATS 2022 Coordinating Followers to Reach Better Equilibria: End-to-End Gradient Descent for Stackelberg Games AAAI 2022 Cost Ensemble with Gradient Selecting for GANs IJCAI 2022 Dataset Distillation by Matching Training Trajectories CVPR 2022