language model training

44 papers

Explore in graph

Also known as

LM

Co-occurring keywords

large language model (12755) language model (4573) downstream task (176) direct preference optimization (317) reinforcement learning (4122) german language (107) instruction following (372) energy efficiency (137) instruction tuning (810) training efficiency (60)

Papers

LiMe: A Latin Corpus of Late Medieval Criminal Sentences COLING 2024

Teaching Language Models to Self-Improve through Interactive Demonstrations NAACL 2024

CSLM: A Framework for Question Answering Dataset Generation through Collaborative Small Language Models EMNLP 2024

LongWanjuan: Towards Systematic Measurement for Long Text Quality EMNLP 2024

$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$ NIPS 2024

Skill-it! A data-driven skills framework for understanding and training language models NIPS 2023

CAME: Confidence-guided Adaptive Memory Efficient Optimization ACL 2023

The ROOTS Search Tool: Data Transparency for LLMs ACL 2023

Text Injection for Capitalization and Turn-Taking Prediction in Speech Models INTERSPEECH 2023

On the Impact of Cross-Domain Data on German Language Models EMNLP 2023

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training EMNLP 2023

Do Data-based Curricula Work? ACL 2022

Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection EMNLP 2022

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset NIPS 2022

Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models NAACL 2022

Hyperparameter Power Impact in Transformer Language Model Training EMNLP 2021

A Cognitive Regularizer for Language Modeling IJCNLP 2021

What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus IJCNLP 2021

An experimental analysis of Noise-Contrastive Estimation: the noise distribution matters EACL 2017