How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers

Gon Buzaglo; Itamar Harel; Mor Shpigel Nacson; Alon Brutzkus; Nathan Srebro; Daniel Soudry

2024 ICML ICML 2024

How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Mathematics & Optimization

Authors

Gon Buzaglo, Itamar Harel, Mor Shpigel Nacson, Alon Brutzkus, Nathan Srebro, Daniel Soudry

Topics

Machine Learning > Optimization & Theory > Learning Theory Deep Learning > Architectures > Neural Networks Mathematics & Optimization > Optimization > Continuous Optimization

Keywords

sample complexity generalization random weight interpolating neural networks narrow teacher redundancy

Download PDF