conftrace_

bias initialization

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

unigram distribution (1) neural network (1) frequency bia (1) frequency prior (1) model initialization (1) relu network (1) sparse activation (1) language model (1) generalization bound (1) rademacher complexity (1)

Papers

Neural Networks with Sparse Activation Induced by Large Bias: Tighter Analysis with Bias-Generalized NTK JMLR 2024 A Natural Bias for Language Generation Models ACL 2023