Skip to content
conftrace_

preference data

38 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (14) reinforcement learning from human feedback (13) direct preference optimization (12) reward model (8) language model alignment (8) preference learning (8) model alignment (4) reward modeling (4) large language model alignment (3) reinforcement learning (3)

Papers

Better Literary Translation: A Multi-Aspect Data Generation and LLM Training Approach ACL 2026 Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model AAAI 2026 Aligning Language Models Using Follow-up Likelihood as Reward Signal AAAI 2025 Aligning Large Language Models with Implicit Preferences from User-Generated Content ACL 2025 Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries EMNLP 2025 Challenges in Trustworthy Human Evaluation of Chatbots NAACL 2025 CM-Align: Consistency-based Multilingual Alignment for Large Language Models EMNLP 2025 Data with High and Consistent Preference Difference Are Better for Reward Model AAAI 2025 Discriminative Policy Optimization for Token-Level Reward Models ICML 2025 Exposing Privacy Gaps: Membership Inference Attack on Preference Data for LLM Alignment AISTATS 2025 Finding the Sweet Spot: Preference Data Construction for Scaling Preference Optimization ACL 2025 InfoPO: On Mutual Information Maximization for Large Language Model Alignment NAACL 2025 Model Editing as a Robust and Denoised variant of DPO: A Case Study on Toxicity ICLR 2025 M-RewardBench: Evaluating Reward Models in Multilingual Settings ACL 2025 MTQ-Eval: Multilingual Text Quality Evaluation for Language Models IJCNLP 2025 Music Arena: Live Evaluation for Text-to-Music NeurIPS 2025 Not All Voices Are Rewarded Equally: Probing and Repairing Reward Models across Human Diversity EMNLP 2025 On a Connection Between Imitation Learning and RLHF ICLR 2025 PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference ACL 2025 PoisonBench: Assessing Language Model Vulnerability to Poisoned Preference Data ICML 2025 Pragyaan: Designing and Curating High-Quality Cultural Post-Training Datasets for Indian Languages EMNLP 2025 Preference Learning for AI Alignment: a Causal Perspective ICML 2025 Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples ICML 2025 Sightation Counts: Leveraging Sighted User Feedback in Building a BLV-aligned Dataset of Diagram Descriptions ACL 2025 Sources of Disagreement in Data for LLM Instruction Tuning COLING 2025