conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Nearest Neighbor Machine Translation is Meta-Optimizer on Output Projection Layer EMNLP 2023
Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance NIPS 2023
Sparse GCA and Thresholded Gradient Descent JMLR 2023
Implicit Bias of Gradient Descent for Mean Squared Error Regression with Two-Layer Wide Neural Networks JMLR 2023
Online Harmonizing Gradient Descent for Imbalanced Data Streams One-Pass Classification IJCAI 2023
Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization NIPS 2023
Breaking the Lower Bound with (Little) Structure: Acceleration in Non-Convex Stochastic Optimization with Heavy-Tailed Noise COLT 2023
Learning Fractals by Gradient Descent AAAI 2023
Understanding Representation Learnability of Nonlinear Self-Supervised Learning AAAI 2023
Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction ICCV 2023
On the Lower Bound of Minimizing Polyak-Łojasiewicz functions COLT 2023
Landscape Learning for Neural Network Inversion ICCV 2023
Symbolic Metamodels for Interpreting Black-Boxes Using Primitive Functions AAAI 2023
Intractability of Learning the Discrete Logarithm with Gradient-Based Methods ACML 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
Domain Generalization Guided by Gradient Signal to Noise Ratio of Parameters ICCV 2023
Implicit Balancing and Regularization: Generalization and Convergence Guarantees for Overparameterized Asymmetric Matrix Sensing COLT 2023
Measuring Asymmetric Gradient Discrepancy in Parallel Continual Learning ICCV 2023
Mean Estimation of Truncated Mixtures of Two Gaussians: A Gradient Based Approach AAAI 2023
Benign Overfitting in Two-layer ReLU Convolutional Neural Networks ICML 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression ICML 2023
On Penalty-based Bilevel Gradient Descent Method ICML 2023
Linearly Constrained Bilevel Optimization: A Smoothed Implicit Gradient Approach ICML 2023
When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario ACL 2023
Robust Linear Regression: Gradient-descent, Early-stopping, and Beyond AISTATS 2023