conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Non-stationary Projection-Free Online Learning with Dynamic and Adaptive Regret Guarantees AAAI 2024
GradTree: Learning Axis-Aligned Decision Trees with Gradient Descent AAAI 2024
Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent AISTATS 2024
QBB: Quantization with Binary Bases for LLMs NIPS 2024
Gradient Reweighting: Towards Imbalanced Class-Incremental Learning CVPR 2024
The Closeness of In-Context Learning and Weight Shifting for Softmax Regression NIPS 2024
Parameter-free Clipped Gradient Descent Meets Polyak NIPS 2024
Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms NIPS 2024
MetaDiff: Meta-Learning with Conditional Diffusion for Few-Shot Learning AAAI 2024
Ink Dot-Oriented Differentiable Optimization for Neural Image Halftoning CVPR 2024
In-Context Learning State Vector with Inner and Momentum Optimization NIPS 2024
On the Power of Small-size Graph Neural Networks for Linear Programming NIPS 2024
Curvature-Invariant Adversarial Attacks for 3D Point Clouds AAAI 2024
Conflict-Alleviated Gradient Descent for Adaptive Object Detection IJCAI 2024
Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context NIPS 2024
Learning Low-Rank Tensor Cores with Probabilistic ℓ0-Regularized Rank Selection for Model Compression IJCAI 2024
Full Parameter Fine-tuning for Large Language Models with Limited Resources ACL 2024
Training Integrable Parameterizations of Deep Neural Networks in the Infinite-Width Limit JMLR 2024
Towards a Theoretical Understanding of the 'Reversal Curse' via Training Dynamics NIPS 2024
Improving Adaptivity via Over-Parameterization in Sequence Models NIPS 2024
EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration AAAI 2024
Offline Model-Based Optimization via Policy-Guided Gradient Search AAAI 2024
On the Unstable Convergence Regime of Gradient Descent AAAI 2024
Estimating the Minimizer and the Minimum Value of a Regression Function under Passive Design JMLR 2024
Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024