gradient descent

Adversarial Robustness in Discontinuous Spaces via Alternating Sampling & Descent WACV 2023 A Fully First-Order Method for Stochastic Bilevel Optimization ICML 2023 Agnostic Learning of General ReLU Activation Using Gradient Descent ICLR 2023 Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing NeurIPS 2023 Aligning Gradient and Hessian for Neural Signed Distance Function NeurIPS 2023 A Line-Search Descent Algorithm for Strict Saddle Functions with Complexity Guarantees JMLR 2023 Approximate Regions of Attraction in Learning with Decision-Dependent Distributions AISTATS 2023 A Unified Approach to Controlling Implicit Regularization via Mirror Descent JMLR 2023 A Unified Discretization Framework for Differential Equation Approach with Lyapunov Arguments for Convex Optimization NeurIPS 2023 Automatic Prompt Optimization with “Gradient Descent” and Beam Search EMNLP 2023 Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity ICML 2023 Backpropagation of Unrolled Solvers with Folded Optimization IJCAI 2023 Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition ICLR 2023 Benign Overfitting in Two-layer ReLU Convolutional Neural Networks ICML 2023 Benign overfitting of non-smooth neural networks beyond lazy training AISTATS 2023 Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for Full-Batch GD ICLR 2023 Beyond NTK with Vanilla Gradient Descent: A Mean-Field Analysis of Neural Networks with Polynomial Width, Samples, and Time NeurIPS 2023 Beyond the Edge of Stability via Two-step Gradient Updates ICML 2023 Breaking the Lower Bound with (Little) Structure: Acceleration in Non-Convex Stochastic Optimization with Heavy-Tailed Noise COLT 2023 Can Forward Gradient Match Backpropagation? ICML 2023 Catalyst Acceleration of Error Compensated Methods Leads to Better Communication Complexity AISTATS 2023 Competitive Gradient Optimization ICML 2023 Complex-valued Neurons Can Learn More but Slower than Real-valued Neurons via Gradient Descent NeurIPS 2023 Continual evaluation for lifelong learning: Identifying the stability gap ICLR 2023 Convergence of Alternating Gradient Descent for Matrix Factorization NeurIPS 2023