Skip to content
conftrace_

heavy-tailed self-regularization

2 papers

Explore in graph

Also known as

HT-SR

Co-occurring keywords · papers mentioning both

empirical spectral density (1) spectral norm regularization (1) large language model (1) weight analysis (1) layer-wise pruning (1) spectral density (1) weight matrix (1) layer-wise learning rate (1) learning rate (1) layer-wise analysis (1)

Papers

AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models NeurIPS 2024 Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training NeurIPS 2023