conftrace_

weight decay regularization

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

weight decay (2) relu network (2) neural network (2) convex optimization (2) linear neural network (1) transformer training (1) critical point (1) wasserstein gradient flow (1) explicit regularization (1) semidefinite program (1)

Papers

Global Convergence in Training Large-Scale Transformers NeurIPS 2024 Optimal Bump Functions for Shallow ReLU networks: Weight Decay, Depth Separation, Curse of Dimensionality JMLR 2024 Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression JMLR 2024 Minimum norm interpolation by perceptra: Explicit regularization and implicit bias NeurIPS 2023 Demystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit Regularization ICLR 2022 Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks ICML 2020 How regularization affects the critical points in linear networks NeurIPS 2017