linear network

Features are fate: a theory of transfer learning in high-dimensional regression ICML 2025 Not all solutions are created equal: An analytical dissociation of functional and representational similarity in deep linear neural networks ICML 2025 Three Mechanisms of Feature Learning in a Linear Network ICLR 2025 Understanding Sharpness Dynamics in NN Training with a Minimalist Example: The Effects of Dataset Difficulty, Depth, Stochasticity, and More ICML 2025 Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning NeurIPS 2024 Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding ICLR 2024 Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes NeurIPS 2024 Only Strict Saddles in the Energy Landscape of Predictive Coding Networks? NeurIPS 2024 SGD vs GD: Rank Deficiency in Linear Networks NeurIPS 2024 Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies ICML 2023 Linear Convergence of Gradient Descent For Finite Width Over-parametrized Linear Networks With General Initialization AISTATS 2023 (S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability NeurIPS 2023 What is the Inductive Bias of Flatness Regularization? A Study of Deep Matrix Factorization Models NeurIPS 2023 Implicit Bias of Linear Equivariant Networks ICML 2022 Implicit Bias of the Step Size in Linear Diagonal Neural Networks ICML 2022 Training invariances and the low-rank phenomenon: beyond linear networks ICLR 2022 A case where a spindly two-layer linear network decisively outperforms any neural network with a fully connected input layer ALT 2021 A Modular Analysis of Provable Acceleration via Polyak’s Momentum: Training a Wide ReLU Network and a Deep Linear Network ICML 2021 On the Explicit Role of Initialization on the Convergence and Implicit Bias of Overparametrized Linear Networks ICML 2021 Implicit Rank-Minimizing Autoencoder NeurIPS 2020 Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks ICLR 2020 Pure and Spurious Critical Points: a Geometric Study of Linear Networks ICLR 2020 Training Linear Neural Networks: Non-Local Convergence and Complexity Results ICML 2020 Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks NeurIPS 2019 Critical Points of Linear Neural Networks: Analytical Forms and Landscape Properties ICLR 2018