conftrace_

weight decay regularization

6 papers

Explore in graph

Co-occurring keywords

weight decay (50) neural network (6616) mean-field limit (6) linear neural network (13) transformer training (13) relu network (143) critical point (24) wasserstein gradient flow (35) explicit regularization (7) minimum norm interpolation (3)

Papers

Global Convergence in Training Large-Scale Transformers NIPS 2024
Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression JMLR 2024
Optimal Bump Functions for Shallow ReLU networks: Weight Decay, Depth Separation, Curse of Dimensionality JMLR 2024
Minimum norm interpolation by perceptra: Explicit regularization and implicit bias NIPS 2023
Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks ICML 2020
How regularization affects the critical points in linear networks NIPS 2017