conftrace_

linear neural network

13 papers

Explore in graph

Co-occurring keywords

gradient descent (1144) matrix factorization (529) critical point (24) deep linear neural network (4) implicit bia (107) implicit regularization (93) loss landscape (149) nonconvex optimization (316) overparameterized model (24) residual network (211)

Papers

Provable Acceleration of Nesterov's Accelerated Gradient for Asymmetric Matrix Factorization and Linear Neural Networks NIPS 2024
Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence AISTATS 2024
The Loss Landscape of Deep Linear Neural Networks: a Second-order Analysis JMLR 2024
Precise asymptotics of reweighted least-squares algorithms for linear diagonal networks NIPS 2024
Implicit Bias of (Stochastic) Gradient Descent for Rank-1 Linear Neural Network NIPS 2023
The Implicit Regularization of Momentum Gradient Descent in Overparametrized Models AAAI 2023
The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks JMLR 2022
Faster Directional Convergence of Linear Neural Networks under Spherically Symmetric Data NIPS 2021
Representation Costs of Linear Neural Networks: Analysis and Design NIPS 2021
Unique Properties of Flat Minima in Deep Networks ICML 2020
Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks NIPS 2019
On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization ICML 2018
How regularization affects the critical points in linear networks NIPS 2017