conftrace_

tokenizer fertility

1 paper

Explore in graph

Also known as

TF

Co-occurring keywords · papers mentioning both

tokenization parity (1) information parity (1) compression efficiency (1) multilingual capabilities (1) multilingual language model (1) text compression (1) language model evaluation (1) information theory (1)

Papers

Information Parity: Measuring and Predicting the Multilingual Capabilities of Language Models EMNLP 2024