conftrace_

l2 regularization

23 papers

Explore in graph

Co-occurring keywords

gradient descent (1144) neural network optimization (1293) dropout regularization (43) deep neural network (1803) inductive bia (272) sparse optimization (246) linear regression (282) sample complexity (1169) stochastic gradient descent (1091) learning theory (519)

Papers

Optimal L2 Regularization in High-dimensional Continual Linear Regression ALT 2026
Stability and L2-penalty in Model Averaging JMLR 2024
Dropout Regularization Versus l2-Penalization in the Linear Model JMLR 2024
The Transient Nature of Emergent In-Context Learning in Transformers NIPS 2023
Asymptotics of $\ell_2$ Regularized Network Embeddings NIPS 2022
Feature Learning in $L_2$-regularized DNNs: Attraction/Repulsion and Sparsity NIPS 2022
Representation Costs of Linear Neural Networks: Analysis and Design NIPS 2021
Understanding Decoupled and Early Weight Decay AAAI 2021
An algorithmic view of L2 regularization and some path-following algorithms JMLR 2021
Learning with Hyperspherical Uniformity AISTATS 2021
Regularization Matters: A Nonparametric Perspective on Overparametrized Neural Network AISTATS 2021
Sample-Efficient L0-L2 Constrained Structure Learning of Sparse Ising Models AAAI 2021
On the training dynamics of deep networks with $L_2$ regularization NIPS 2020
Autoencoders that don't overfit towards the Identity NIPS 2020
What is the Effect of Importance Weighting in Deep Learning? ICML 2019
Fast Automatic Smoothing for Generalized Additive Models JMLR 2019
Collaboratively Weighting Deep and Classic Representation via $l_2$ Regularization for Image Classification ACML 2018
A Second-order Look at Stability and Generalization COLT 2017
Oracle Based Active Set Algorithm for Scalable Elastic Net Subspace Clustering CVPR 2016
On the Inductive Bias of Dropout JMLR 2015
Fast, Exact Model Selection and Permutation Testing for l2-Regularized Logistic Regression AISTATS 2012
Tight Sample Complexity of Large-Margin Learning NIPS 2010
Regularized Policy Iteration NIPS 2008