conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Globally Convergent Variational Inference NIPS 2024
S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training NIPS 2024
Evolution and learning in differentiable robots RSS 2024
Provable Acceleration of Nesterov's Accelerated Gradient for Asymmetric Matrix Factorization and Linear Neural Networks NIPS 2024
Pruning is Optimal for Learning Sparse Features in High-Dimensions COLT 2024
ST$_k$: A Scalable Module for Solving Top-k Problems NIPS 2024
The Sample Complexity of Gradient Descent in Stochastic Convex Optimization NIPS 2024
Non-stationary Projection-Free Online Learning with Dynamic and Adaptive Regret Guarantees AAAI 2024
Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency COLT 2024
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization AISTATS 2024
Private Stochastic Convex Optimization with Heavy Tails: Near-Optimality from Simple Reductions NIPS 2024
Acceleration and Implicit Regularization in Gaussian Phase Retrieval AISTATS 2024
Generalization and Stability of Interpolating Neural Networks with Minimal Width JMLR 2024
On the Nyström Approximation for Preconditioning in Kernel Machines AISTATS 2024
Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent AISTATS 2024
Soft ascent-descent as a stable and flexible alternative to flooding NIPS 2024
Unraveling the Gradient Descent Dynamics of Transformers NIPS 2024
Initializing Services in Interactive ML Systems for Diverse Users NIPS 2024
Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimization NIPS 2024
Differentially Private Optimization with Sparse Gradients NIPS 2024
In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization NIPS 2024
Ink Dot-Oriented Differentiable Optimization for Neural Image Halftoning CVPR 2024
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NIPS 2024
Estimating the Minimizer and the Minimum Value of a Regression Function under Passive Design JMLR 2024
How does PDE order affect the convergence of PINNs? NIPS 2024