Scaling Behavior for Large Language Models regarding Numeral Systems: An Example using Pythia

Zhejian Zhou; Jiayu Wang; Dahua Lin; Kai Chen

2024 EMNLP EMNLP 2024

Scaling Behavior for Large Language Models regarding Numeral Systems: An Example using Pythia

🧭 Keyword Pioneer - numerical understanding

🐝 Cross-Pollinator - Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Speech & Audio

Authors

Zhejian Zhou , Jiayu Wang , Dahua Lin , Kai Chen

Topics

Natural Language Processing > Resources & Methods > Large Language Models

Keywords

numerical understanding scaling law pretrained language model large language model

Download PDF

Related papers

EmbodiedBERT: Cognitively Informed Metaphor Detection Incorporating Sensorimotor Information 2024

Mitigating Matthew Effect: Multi-Hypergraph Boosted Multi-Interest Self-Supervised Learning for Conversational Recommendation 2024

Learning to Extract Structured Entities Using Language Models 2024

Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis 2024

CSSL: Contrastive Self-Supervised Learning for Dependency Parsing on Relatively Free Word Ordered and Morphologically Rich Low Resource Languages 2024