conftrace_

preference data

38 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (14) reinforcement learning from human feedback (13) direct preference optimization (12) reward model (8) language model alignment (8) preference learning (8) model alignment (4) reward modeling (4) large language model alignment (3) reinforcement learning (3)

Papers

Ask Again, Then Fail: Large Language Models’ Vacillations in Judgment ACL 2024 Direct Large Language Model Alignment Through Self-Rewarding Contrastive Prompt Distillation ACL 2024 DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging EMNLP 2024 Enabling Lanuguage Models to Implicitly Learn Self-Improvement ICLR 2024 Evolutionary Contrastive Distillation for Language Model Alignment EMNLP 2024 Policy Evaluation for Reinforcement Learning from Human Feedback: A Sample Complexity Analysis AISTATS 2024 Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generation ACL 2024 Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment EMNLP 2024 Reward Modeling Requires Automatic Adjustment Based on Data Quality EMNLP 2024 Semi-Supervised Reward Modeling via Iterative Self-Training EMNLP 2024 Value Imprint: A Technique for Auditing the Human Values Embedded in RLHF Datasets NeurIPS 2024 Direct Preference Optimization: Your Language Model is Secretly a Reward Model NeurIPS 2023 Robust Consensus in Ranking Data Analysis: Definitions, Properties and Computational Issues ICML 2023