conftrace_

statistical mechanics

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

network pruning (2) self-attention network (1) attention path (1) generalization performance (1) weight distribution (1) memory capacity (1) poisson disk sampling (1) sample design (1) blue noise sampling (1) plateau phenomenon (1)

Papers

Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers NeurIPS 2024 A Three-regime Model of Network Pruning ICML 2023 A theory of weight distribution-constrained learning NeurIPS 2022 Ising Model Selection Using ℓ_1-Regularized Linear Regression: A Statistical Mechanics Analysis NeurIPS 2021 Statistical mechanical analysis of neural network pruning UAI 2021 A Statistical Mechanics Framework for Task-Agnostic Sample Design in Machine Learning NeurIPS 2020 Data-Dependence of Plateau Phenomenon in Learning with Neural Network --- Statistical Mechanical Analysis NeurIPS 2019