conftrace_

statistical mechanics

7 papers

Explore in graph

Co-occurring keywords

network pruning (183) self-attention network (56) attention path (1) generalization performance (97) weight distribution (7) memory capacity (11) poisson disk sampling (2) sample design (2) blue noise sampling (1) plateau phenomenon (1)

Papers

Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers NIPS 2024
A Three-regime Model of Network Pruning ICML 2023
A theory of weight distribution-constrained learning NIPS 2022
Ising Model Selection Using $\ell_{1}$-Regularized Linear Regression: A Statistical Mechanics Analysis NIPS 2021
Statistical mechanical analysis of neural network pruning UAI 2021
A Statistical Mechanics Framework for Task-Agnostic Sample Design in Machine Learning NIPS 2020
Data-Dependence of Plateau Phenomenon in Learning with Neural Network --- Statistical Mechanical Analysis NIPS 2019