conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

SMG: A Shuffling Gradient-Based Method with Momentum ICML 2021
Unitary Branching Programs: Learnability and Lower Bounds ICML 2021
Continuous Time Analysis of Momentum Methods JMLR 2021
Rethinking Neural vs. Matrix-Factorization Collaborative Filtering: the Theoretical Perspectives ICML 2021
Meta-Learning Bidirectional Update Rules ICML 2021
Learning about Word Vector Representations and Deep Learning through Implementing Word2vec NAACL 2021
Inverse Reinforcement Learning from a Gradient-based Learner NIPS 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout NIPS 2020
Cogradient Descent for Bilinear Optimization CVPR 2020
Alleviation of Gradient Exploding in GANs: Fake Can Be Real CVPR 2020
Optimal and Practical Algorithms for Smooth and Strongly Convex Decentralized Optimization NIPS 2020
Understanding Attention for Text Classification ACL 2020
Outlier Robust Mean Estimation with Subgaussian Rates via Stability NIPS 2020
Robust Recovery via Implicit Bias of Discrepant Learning Rates for Double Over-parameterization NIPS 2020
Implicit Regularization in Deep Learning May Not Be Explainable by Norms NIPS 2020
Tight First- and Second-Order Regret Bounds for Adversarial Linear Bandits NIPS 2020
Large-Scale Methods for Distributionally Robust Optimization NIPS 2020
Exploiting Higher Order Smoothness in Derivative-free Optimization and Continuous Bandits NIPS 2020
Dinkelbach-Type Algorithm for Computing Quantal Stackelberg Equilibrium IJCAI 2020
Improving First-Order Optimization Algorithms (Student Abstract) AAAI 2020
Gradient Boosts the Approximate Vanishing Ideal AAAI 2020
Rank Aggregation via Heterogeneous Thurstone Preference Models AAAI 2020
A New Ensemble Adversarial Attack Powered by Long-Term Gradient Memories AAAI 2020
Adversarial Dynamic Shapelet Networks AAAI 2020
Partial Adversarial Behavior Deception in Security Games IJCAI 2020