Skip to content
conftrace_
2026 EMNLP EMNLP 2026

One Example Is Enough to Pass Fairness Benchmarks: Rethinking Fairness Evaluation for Aligned LLMs

AbstractFairness benchmarks such as BBQ have become the de facto standard for fairness evaluation across major model families. We argue that these benchmarks are too easy to saturate to support that role: training Qwen 2.5 7B Base with Group Relative Policy Optimization (GRPO) on a single BBQ example lifts mean BBQ accuracy from 79.9 to 92.0 across all 11 social-bias categories, closing of the gap to the large-scale RLHF counterpart, and the effect generalizes across model families. A cross-conditioning analysis shows the improvement is carried by the reasoning traces generated by the model, not by the output head; one example suffices to elicit a category-agnostic “missing evidence” reasoning pattern. Strikingly, placing that single example in context as a one-shot demonstration—with no weight update—likewise reaches comparable BBQ accuracy and produces reasoning a fairness reward model rates as equally fair, confirming that the benchmark is saturable without gradient-based alignment. We argue that BBQ-style multiple-choice abstention benchmarks measure a single structural cue, and a model that solves them does not thereby become fair. We call for evaluation suites that cover a broader spectrum of fairness alignment.

More from EMNLP 2026

All EMNLP 2026 papers →