conftrace_

rényi entropy

3 papers

Explore in graph

Co-occurring keywords

generalized nearest-neighbor (1) shannon entropy (26) subword tokenization (131) renyi entropy (11) nearest neighbor graph (21) tokenizer efficiency (2) information-theoretic quantification (1) language optimality (1) empirical copula (1) nonparametric estimation (98)

Papers

Tokenization and the Noiseless Channel ACL 2023
On Homophony and Rényi Entropy EMNLP 2021
Estimation of Rényi Entropy and Mutual Information Based on Generalized Nearest-Neighbor Graphs NIPS 2010