Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Proportionate Responses: The Case for Small Language Models as Sustainable Expert Climate Policy Annotators

AbstractTracking progress on climate change adaptation requires systematic and robust annotation of adaptation policies, but manual annotation has become infeasible due to the rapidly growing volume of unstructured documents. Pre-trained language models (LMs) have emerged as promising tools for automating and scaling annotation. However, relatively little is known about their accuracy and quality on complex, free-text annotation tasks. Meanwhile, large LMs (LLMs) are increasingly deployed for large scale text analyses despite their considerable environmental footprint and limited exploration of more sustainable alternatives. By benchmarking model accuracy against human inter-annotator agreement, reviewing perceived annotation quality, and estimating energy and water consumption, we show that fine-tuning small LMs (SLMs) provides a substantially more sustainable alternative to LLMs with only marginal reductions in accuracy and improved perceived annotation quality. Furthermore, we demonstrate the importance of evaluating complex annotation tasks beyond accuracy against human gold standard annotation as ambiguity and human error can obscure meaningful differences in model performance. By reducing the costs of high-quality policy annotation, our approach enables the scalable knowledge extraction needed for tracking progress on adaptation, living evidence syntheses, and evidence-informed policy evaluation.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

More from EMNLP 2026

All EMNLP 2026 papers →