Skip to content
conftrace_

token frequency

8 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) pretraining data (2) language model (2) data mixture (1) linear program (1) training data composition (1) long-tail distribution (1) membership inference (1) layer normalization (1) membership inference attack (1)

Papers

Ranking Human and LLM Texts Using Locality Statistics EACL 2026 Long-Tail Crisis in Nearest Neighbor Language Models NAACL 2025 Confidence Regulation Neurons in Language Models NeurIPS 2024 Data Mixture Inference Attack: BPE Tokenizers Reveal Training Data Compositions NeurIPS 2024 MiLe Loss: a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models NAACL 2024 Frequency Balanced Datasets Lead to Better Language Models EMNLP 2023 Frequency-aware SGD for Efficient Embedding Learning with Provable Benefits ICLR 2022 Token-level Adaptive Training for Neural Machine Translation EMNLP 2020