language model training

44 papers

Explore in graph

Also known as

LM

Co-occurring keywords

large language model (12755) language model (4573) downstream task (176) direct preference optimization (317) reinforcement learning (4122) german language (107) instruction following (372) energy efficiency (137) instruction tuning (810) training efficiency (60)

Papers

Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives EACL 2026

Understanding Reference Policies in Direct Preference Optimization NAACL 2025

T-REG: Preference Optimization with Token-Level Reward Regularization ACL 2025

Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language ACL 2025

Phases of Uncertainty: Confidence–Calibration Dynamics in Language Model Training EMNLP 2025

DIDS: Domain Impact-aware Data Sampling for Large Language Model Training EMNLP 2025

Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models EMNLP 2025

VerIF: Verification Engineering for Reinforcement Learning in Instruction Following EMNLP 2025

Studying the Role of Input-Neighbor Overlap in Retrieval-Augmented Language Models Training Efficiency EMNLP 2025

Balancing the Budget: Understanding Trade-offs Between Supervised and Preference-Based Finetuning ACL 2025

Empirical Evaluation of Loss Masking to Selectively Prevent Memorization ACL 2025

What did you say? Generating Child-Directed Speech Questions to Train LLMs EMNLP 2025

NOVER: Incentive Training for Language Models via Verifier-Free Reinforcement Learning EMNLP 2025

Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability ACL 2025

LLäMmlein: Transparent, Compact and Competitive German-Only Language Models from Scratch ACL 2025

MANTA: A Scalable Pipeline for Transmuting Massive Web Corpora into Instruction Datasets EMNLP 2025

FastMCTS: A Simple Sampling Strategy for Data Synthesis ACL 2025

AutoMixer: Checkpoint Artifacts as Automatic Data Mixers ACL 2025

Matina: A Large-Scale 73B Token Persian Text Corpus NAACL 2025

A Proactive Reliability Metric for Detecting Failures in Language Model Training EMNLP 2025

Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint ACL 2024

Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models ACL 2024

Balanced Data Sampling for Language Model Training with Clustering ACL 2024

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages COLING 2024

Do Language Models Care about Text Quality? Evaluating Web-Crawled Corpora across 11 Languages COLING 2024