conftrace_

rényi entropy

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

renyi entropy (2) generalized nearest-neighbor (1) shannon entropy (1) convergence rate (1) subword tokenization (1) nearest neighbor graph (1) tokenizer efficiency (1) information-theoretic quantification (1) language optimality (1) empirical copula (1)

Papers

Tokenization and the Noiseless Channel ACL 2023 On Homophony and Rényi Entropy EMNLP 2021 Estimation of Rényi Entropy and Mutual Information Based on Generalized Nearest-Neighbor Graphs NeurIPS 2010