conftrace_

language model alignment

142 papers

Explore in graph

Co-occurring keywords

large language model (13587) reinforcement learning from human feedback (278) direct preference optimization (332) reinforcement learning (4352) preference learning (418) reward model (276) preference optimization (302) model alignment (226) reward modeling (164) language model (4599)

Papers

Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment EMNLP 2024
Aligning Language Models to Explicitly Handle Ambiguity EMNLP 2024
LIONs: An Empirically Optimized Approach to Align Language Models EMNLP 2024
On the Relationship between Truth and Political Bias in Language Models EMNLP 2024
ALaRM: Align Language Models via Hierarchical Rewards Modeling ACL 2024
The Accuracy Paradox in RLHF: When Better Reward Models Don’t Yield Better Language Models EMNLP 2024
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning EMNLP 2024
Don’t Forget Your Reward Values: Language Model Alignment via Value-based Calibration EMNLP 2024
Filtered Direct Preference Optimization EMNLP 2024
Reward Modeling Requires Automatic Adjustment Based on Data Quality EMNLP 2024
Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data EMNLP 2024
Standardize: Aligning Language Models with Expert-Defined Standards for Content Generation EMNLP 2024
ORPO: Monolithic Preference Optimization without Reference Model EMNLP 2024
Geometric-Averaged Preference Optimization for Soft Preference Labels NIPS 2024
Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels NIPS 2024
Improving Context-Aware Preference Modeling for Language Models NIPS 2024
Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting EACL 2024
The Paradox of Preference: A Study on LLM Alignment Algorithms and Data Acquisition Methods NAACL 2024
Safer-Instruct: Aligning Language Models with Automated Preference Data NAACL 2024
Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs ACL 2024
Direct Preference Optimization with an Offset ACL 2024
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization ACL 2024
Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models? ACL 2024
Uncertainty Aware Learning for Language Model Alignment ACL 2024
DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging EMNLP 2024