conftrace_

unigram distribution

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

bigram distribution (1) frequency bia (1) softmax optimization (1) bias initialization (1) noise distribution (1) frequency prior (1) model initialization (1) softmax approximation (1) noise contrastive estimation (1) language model (1)

Papers

A Natural Bias for Language Generation Models ACL 2023 An experimental analysis of Noise-Contrastive Estimation: the noise distribution matters EACL 2017