Skip to content
conftrace_

reference model

11 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) preference alignment (3) direct preference optimization (3) membership inference attack (2) model alignment (2) language model privacy (1) neighbourhood comparison (1) neighbourhood attack (1) text dataset (1) reference attack (1)

Papers

Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model AAAI 2026 Select Before Use: On the Importance of Reference Model Selection in Preference Alignment ACL 2026 AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization ICML 2025 Free Process Rewards without Process Labels ICML 2025 Multi-Reference Preference Optimization for Large Language Models AAAI 2025 Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models ICLR 2025 sDPO: Don’t Use Your Data All at Once COLING 2025 SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters ICLR 2025 Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning ICML 2025 Low-Cost High-Power Membership Inference Attacks ICML 2024 Membership Inference Attacks against Language Models via Neighbourhood Comparison ACL 2023