conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Replica Exchange for Non-Convex Optimization JMLR 2021
Decentralized Riemannian Gradient Descent on the Stiefel Manifold ICML 2021
Differentially Private Stochastic Coordinate Descent AAAI 2021
A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraints JMLR 2021
On a Combination of Alternating Minimization and Nesterov’s Momentum ICML 2021
Differentiable Sorting Networks for Scalable Sorting and Ranking Supervision ICML 2021
Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix Factorization NIPS 2021
A case where a spindly two-layer linear network decisively outperforms any neural network with a fully connected input layer ALT 2021
The Contour to Classification Game AAAI 2021
Linear Convergence of Gradient Methods for Estimating Structured Transition Matrices in High-dimensional Vector Autoregressive Models NIPS 2021
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix AISTATS 2021
Tensor Programs IV: Feature Learning in Infinite-Width Neural Networks ICML 2021
Implicit Regularization in Matrix Sensing via Mirror Descent NIPS 2021
How Data Augmentation affects Optimization for Linear Regression NIPS 2021
Exponentially Many Local Minima in Quantum Neural Networks ICML 2021
Regularization Matters: A Nonparametric Perspective on Overparametrized Neural Network AISTATS 2021
Robust Regression Revisited: Acceleration and Improved Estimation Rates NIPS 2021
Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis NIPS 2021
Receptive Field Size Optimization With Continuous Time Pooling WACV 2021
R-SLAM: Optimizing Eye Tracking From Rolling Shutter Video of the Retina ICCV 2021
Characterizing the implicit bias via a primal-dual analysis ALT 2021
IDARTS: Interactive Differentiable Architecture Search ICCV 2021
Data-Efficient Alignment of Multimodal Sequences by Aligning Gradient Updates and Internal Feature Distributions WACV 2021
Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generation ICML 2021
Fast margin maximization via dual acceleration ICML 2021