conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Superpolynomial Lower Bounds for Learning One-Layer Neural Networks using Gradient Descent ICML 2020
SIGUA: Forgetting May Make Learning with Noisy Labels More Robust ICML 2020
Compressive sensing with un-trained neural networks: Gradient descent finds a smooth approximation ICML 2020
Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020
Optimal transport mapping via input convex neural networks ICML 2020
Unique Properties of Flat Minima in Deep Networks ICML 2020
Eliminating the Invariance on the Loss Landscape of Linear Autoencoders ICML 2020
Randomized Block-Diagonal Preconditioning for Parallel Learning ICML 2020
Optimizing Data Usage via Differentiable Rewards ICML 2020
An Implicit Form of Krasulina's k-PCA Update without the Orthonormality Constraint AAAI 2020
Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory AAAI 2020
Streaming Batch Gradient Tracking for Neural Network Training (Student Abstract) AAAI 2020
Highway Transformer: Self-Gating Enhanced Self-Attentive Networks ACL 2020
CoachGAN WACV 2020
Position-based Scaled Gradient for Model Quantization and Pruning NIPS 2020
Feature Selection using Stochastic Gates ICML 2020
A Sample Complexity Separation between Non-Convex and Convex Meta-Learning ICML 2020
The Performance Analysis of Generalized Margin Maximizers on Separable Data ICML 2020
Decentralised Learning with Random Features and Distributed Gradient Descent ICML 2020
Adaptive Gradient Descent without Descent ICML 2020
Escaping the Gravitational Pull of Softmax NIPS 2020
On the Loss Landscape of Adversarial Training: Identifying Challenges and How to Overcome Them NIPS 2020
Implicit Learning Dynamics in Stackelberg Games: Equilibria Characterization, Convergence Analysis, and Empirical Study ICML 2020
Boosting Frank-Wolfe by Chasing Gradients ICML 2020
Beyond Lazy Training for Over-parameterized Tensor Decomposition NIPS 2020