conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Full Parameter Fine-tuning for Large Language Models with Limited Resources ACL 2024
Langevin Unlearning: A New Perspective of Noisy Gradient Descent for Machine Unlearning NIPS 2024
Grokking phase transitions in learning local rules with gradient descent JMLR 2024
Provable Accelerated Convergence of Nesterov’s Momentum for Deep ReLU Neural Networks ALT 2024
Neural Redshift: Random Networks are not Random Functions CVPR 2024
Initializing Services in Interactive ML Systems for Diverse Users NIPS 2024
GGD: Grafting Gradient Descent JMLR 2024
Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent AISTATS 2024
Towards a Theoretical Understanding of the 'Reversal Curse' via Training Dynamics NIPS 2024
Gradient Reweighting: Towards Imbalanced Class-Incremental Learning CVPR 2024
Unraveling the Gradient Descent Dynamics of Transformers NIPS 2024
On the Nyström Approximation for Preconditioning in Kernel Machines AISTATS 2024
Convergence of Gradient Descent with Small Initialization for Unregularized Matrix Completion COLT 2024
Neural collapse vs. low-rank bias: Is deep neural collapse really optimal? NIPS 2024
QLABGrad: A Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning AAAI 2024
Performative Control for Linear Dynamical Systems NIPS 2024
Fix-A-Step: Semi-supervised Learning From Uncurated Unlabeled Data AISTATS 2023
Measuring Asymmetric Gradient Discrepancy in Parallel Continual Learning ICCV 2023
Global optimality of Elman-type RNNs in the mean-field regime ICML 2023
Landscape Learning for Neural Network Inversion ICCV 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
Domain Generalization Guided by Gradient Signal to Noise Ratio of Parameters ICCV 2023
Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction ICCV 2023
Implicit Bias of Gradient Descent for Mean Squared Error Regression with Two-Layer Wide Neural Networks JMLR 2023
Sparse GCA and Thresholded Gradient Descent JMLR 2023