conftrace_
← Keywords

language model training

44 papers

Explore in graph

Co-occurring keywords

large language model (12755) language model (4573) downstream task (176) direct preference optimization (317) reinforcement learning (4122) german language (107) instruction following (372) energy efficiency (137) instruction tuning (810) training efficiency (60)

Papers

Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives EACL 2026
Understanding Reference Policies in Direct Preference Optimization NAACL 2025
T-REG: Preference Optimization with Token-Level Reward Regularization ACL 2025
Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language ACL 2025
Phases of Uncertainty: Confidence–Calibration Dynamics in Language Model Training EMNLP 2025
DIDS: Domain Impact-aware Data Sampling for Large Language Model Training EMNLP 2025
Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models EMNLP 2025
VerIF: Verification Engineering for Reinforcement Learning in Instruction Following EMNLP 2025
Studying the Role of Input-Neighbor Overlap in Retrieval-Augmented Language Models Training Efficiency EMNLP 2025
Balancing the Budget: Understanding Trade-offs Between Supervised and Preference-Based Finetuning ACL 2025
Empirical Evaluation of Loss Masking to Selectively Prevent Memorization ACL 2025
What did you say? Generating Child-Directed Speech Questions to Train LLMs EMNLP 2025
NOVER: Incentive Training for Language Models via Verifier-Free Reinforcement Learning EMNLP 2025
Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability ACL 2025
LLäMmlein: Transparent, Compact and Competitive German-Only Language Models from Scratch ACL 2025
MANTA: A Scalable Pipeline for Transmuting Massive Web Corpora into Instruction Datasets EMNLP 2025
FastMCTS: A Simple Sampling Strategy for Data Synthesis ACL 2025
AutoMixer: Checkpoint Artifacts as Automatic Data Mixers ACL 2025
Matina: A Large-Scale 73B Token Persian Text Corpus NAACL 2025
A Proactive Reliability Metric for Detecting Failures in Language Model Training EMNLP 2025
Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint ACL 2024
Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models ACL 2024
Balanced Data Sampling for Language Model Training with Clustering ACL 2024
CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages COLING 2024
Do Language Models Care about Text Quality? Evaluating Web-Crawled Corpora across 11 Languages COLING 2024