gradient descent

Neural-Pull: Learning Signed Distance Function from Point clouds by Learning to Pull Space onto Surface ICML 2021 Never Go Full Batch (in Stochastic Convex Optimization) NeurIPS 2021 Noether’s Learning Dynamics: Role of Symmetry Breaking in Neural Networks NeurIPS 2021 Noisy Gradient Descent Converges to Flat Minima for Nonconvex Matrix Factorization AISTATS 2021 Non-asymptotic convergence bounds for Wasserstein approximation using point clouds NeurIPS 2021 Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis NeurIPS 2021 Numerical influence of ReLU’(0) on backpropagation NeurIPS 2021 On a Combination of Alternating Minimization and Nesterov’s Momentum ICML 2021 On Continuous Local BDD-Based Search for Hybrid SAT Solving AAAI 2021 On Estimation in Latent Variable Models ICML 2021 On Learnability via Gradient Method for Two-Layer ReLU Neural Networks in Teacher-Student Setting ICML 2021 Online Convex Optimization with Continuous Switching Constraint NeurIPS 2021 Online Learning for Load Balancing of Unknown Monotone Resource Allocation Games ICML 2021 Online Optimal Control with Affine Constraints AAAI 2021 On Optimal Interpolation in Linear Regression NeurIPS 2021 On the Curse of Memory in Recurrent Neural Networks: Approximation and Optimization Analysis ICLR 2021 On the Dynamics of Training Attention Models ICLR 2021 On the Explicit Role of Initialization on the Convergence and Implicit Bias of Overparametrized Linear Networks ICML 2021 On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models ICML 2021 On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent ICML 2021 On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths ICML 2021 On the Role of Optimization in Double Descent: A Least Squares Study NeurIPS 2021 Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth ICML 2021 Optimizing Optimizers: Regret-optimal gradient descent algorithms COLT 2021 Optimizing persistent homology based functions ICML 2021