conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression NIPS 2023
Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs NIPS 2023
Exploiting hidden structures in non-convex games for convergence to Nash equilibrium NIPS 2023
Flexible risk design using bi-directional dispersion AISTATS 2023
On the Role of Attention in Prompt-tuning ICML 2023
A Unified Discretization Framework for Differential Equation Approach with Lyapunov Arguments for Convex Optimization NIPS 2023
Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign? NIPS 2023
Gradient Descent with Linearly Correlated Noise: Theory and Applications to Differential Privacy NIPS 2023
From Perception to Programs: Regularize, Overparameterize, and Amortize ICML 2023
Convergence of Alternating Gradient Descent for Matrix Factorization NIPS 2023
On the Dynamics Under the Unhinged Loss and Beyond JMLR 2023
Symbolic Metamodels for Interpreting Black-Boxes Using Primitive Functions AAAI 2023
Target-based Surrogates for Stochastic Optimization ICML 2023
Mechanic: A Learning Rate Tuner NIPS 2023
Robust Camera Pose Refinement for Multi-Resolution Hash Encoding ICML 2023
Don’t blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy NIPS 2023
QuACK: Accelerating Gradient-Based Quantum Optimization with Koopman Operator Learning NIPS 2023
Convex and Non-convex Optimization Under Generalized Smoothness NIPS 2023
Neural Stochastic Differential Games for Time-series Analysis ICML 2023
Memory-Constrained Algorithms for Convex Optimization NIPS 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression ICML 2023
Extending Kernel PCA through Dualization: Sparsity, Robustness and Fast Algorithms ICML 2023
DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method NIPS 2023
Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing NIPS 2023
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression ICML 2023