conftrace_

diagonal linear network

7 papers

Explore in graph

Co-occurring keywords

gradient flow (142) implicit bia (107) implicit regularization (93) stochastic gradient descent (1091) sparse regression (175) momentum gradient descent (2) continuous-time analysis (3) overparameterized regression (3) edge of stability (14) gradient regularization (20)

Papers

Effects of Momentum in Implicit Bias of Gradient Flow for Diagonal Linear Networks AAAI 2025
Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks AISTATS 2024
(S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability NIPS 2023
Understanding Gradient Regularization in Deep Learning: Efficient Finite-Difference Computation and Implicit Bias ICML 2023
Incremental Learning in Diagonal Linear Networks JMLR 2023
Saddle-to-Saddle Dynamics in Diagonal Linear Networks NIPS 2023
Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity NIPS 2021