conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

**Paper retracted by author request (see pdf for retraction notice from the authors)** Nonparametric Regression with Shallow Overparameterized Neural Networks Trained by GD with Early Stopping COLT 2021
The staircase property: How hierarchical structure can guide deep learning NIPS 2021
Modeling from Features: a Mean-field Framework for Over-parameterized Deep Neural Networks COLT 2021
Characterizing the Loss Landscape in Non-Negative Matrix Factorization AAAI 2021
Large Batch Optimization for Deep Learning Using New Complete Layer-Wise Adaptive Rate Scaling AAAI 2021
PID-Based Approach to Adversarial Attacks AAAI 2021
Corrected CBOW Performs as well as Skip-gram EMNLP 2021
A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization ICML 2021
Closing the Gap: Tighter Analysis of Alternating Stochastic Gradient Methods for Bilevel Problems NIPS 2021
Multi-Receiver Online Bayesian Persuasion ICML 2021
Cross-Gradient Aggregation for Decentralized Learning from Non-IID Data ICML 2021
A Recipe for Global Convergence Guarantee in Deep Neural Networks AAAI 2021
Agnostic Learning of Halfspaces with Gradient Descent via Soft Margins ICML 2021
$\alpha$-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression NIPS 2021
Heavy Ball Neural Ordinary Differential Equations NIPS 2021
Neural-Pull: Learning Signed Distance Function from Point clouds by Learning to Pull Space onto Surface ICML 2021
When Does Gradient Descent with Logistic Loss Find Interpolating Two-Layer Networks? JMLR 2021
Implicit rate-constrained optimization of non-decomposable objectives ICML 2021
Understanding Decoupled and Early Weight Decay AAAI 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization ICML 2021
Gradient-Based Algorithms for Machine Teaching CVPR 2021
Temporal Difference Learning as Gradient Splitting ICML 2021
Asynchronous Stochastic Optimization Robust to Arbitrary Delays NIPS 2021
How Fine-Tuning Allows for Effective Meta-Learning NIPS 2021
Escape saddle points by a simple gradient-descent based algorithm NIPS 2021