model alignment

Spectral Editing of Activations for Large Language Model Alignment NeurIPS 2024 Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections NAACL 2024 Teaching Language Models to Self-Improve by Learning from Language Feedback ACL 2024 The Accuracy Paradox in RLHF: When Better Reward Models Don’t Yield Better Language Models EMNLP 2024 The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models NeurIPS 2024 Towards Healthy AI: Large Language Models Need Therapists Too NAACL 2024 TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models EMNLP 2024 Unintended Impacts of LLM Alignment on Global Representation ACL 2024 Universal Jailbreak Backdoors from Poisoned Human Feedback ICLR 2024 VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment EMNLP 2024 Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models NeurIPS 2024 What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning ICLR 2024 Analyzing Transformers in Embedding Space ACL 2023 A Spectral Theory of Neural Prediction and Alignment NeurIPS 2023 Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate EMNLP 2023 Collaborative Alignment of NLP Models NeurIPS 2023 Human Preference Score: Better Aligning Text-to-Image Models with Human Preference ICCV 2023 Interpretability at Scale: Identifying Causal Mechanisms in Alpaca NeurIPS 2023 Language Model Alignment with Elastic Reset NeurIPS 2023 LIMA: Less Is More for Alignment NeurIPS 2023 On the Exploitability of Instruction Tuning NeurIPS 2023 OpenAssistant Conversations - Democratizing Large Language Model Alignment NeurIPS 2023 Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards NeurIPS 2023 SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF EMNLP 2023 Tuna: Instruction Tuning using Feedback from Large Language Models EMNLP 2023