gradient descent

Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context NeurIPS 2024 Private Gradient Descent for Linear Regression: Tighter Error Bounds and Instance-Specific Uncertainty Estimation ICML 2024 Private Stochastic Convex Optimization with Heavy Tails: Near-Optimality from Simple Reductions NeurIPS 2024 Provable Accelerated Convergence of Nesterov’s Momentum for Deep ReLU Neural Networks ALT 2024 Provable Acceleration of Nesterov's Accelerated Gradient for Asymmetric Matrix Factorization and Linear Neural Networks NeurIPS 2024 Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024 Pruning is Optimal for Learning Sparse Features in High-Dimensions COLT 2024 QBB: Quantization with Binary Bases for LLMs NeurIPS 2024 QLABGrad: A Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning AAAI 2024 Random Function Descent NeurIPS 2024 Robust and Faster Zeroth-Order Minimax Optimization: Complexity and Applications NeurIPS 2024 Robust Neural Contextual Bandit against Adversarial Corruptions NeurIPS 2024 SDEs for Minimax Optimization AISTATS 2024 "Segment, Lift and Fit: Automatic 3D Shape Labeling from 2D Prompts" ECCV 2024 Sharpness-Aware Minimization and the Edge of Stability JMLR 2024 Soft ascent-descent as a stable and flexible alternative to flooding NeurIPS 2024 S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training NeurIPS 2024 ST$_k$: A Scalable Module for Solving Top-k Problems NeurIPS 2024 Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes NeurIPS 2024 Symbolic Cognitive Diagnosis via Hybrid Optimization for Intelligent Education Systems AAAI 2024 Synaptic Weight Distributions Depend on the Geometry of Plasticity ICLR 2024 The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents ICML 2024 The Closeness of In-Context Learning and Weight Shifting for Softmax Regression NeurIPS 2024 The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks NeurIPS 2024 The Implicit Bias of Gradient Descent on Separable Multiclass Data NeurIPS 2024