Skip to content
conftrace_
2026 EMNLP EMNLP 2026

It Knows More Than It Can Say: Self-Evolving Prompts for Extremely Low-Resource Languages

AbstractStructured prompting can make large language models (LLMs) speak languages that are virtually absent from their training data: for Tulu, a Dravidian language with over two million speakers, a hand-crafted five-layer prompt reduces vocabulary contamination from the dominant neighbour Kannada from 80% to 5% with zero parameter updates. But that prompt took native speakers and targeted elicitation sessions to build: an expert bottleneck that cannot scale to the thousands of languages in the same situation. We introduce CIPHER (Contrastive Iterative Prompt Heuristic Evolution for Resourcescarce languages), which removes the expert from the loop by making the model be its own linguist. A single LLM plays every role: it translates, contrastively diagnoses its own errors against references, abstracts recurring defects into canonical linguistic rules, routes each rule to the prompt layer that repairs it, and generates judge-filtered self-play data, while an outer evolutionary loop mutates the prompt architecture itself under Pareto selection, including discovering new layer types. From 250 translation pairs and no human curation, CIPHER mines 3,471 typed error records, eliminates contamination at every scale we test (47%→0% for a 3B model), raises grammar accuracy from 28% to 44% with GPT-5, and autonomously invents a contamination-filter layer that yields the best architecture found. The evolved prompt is a compact, human-auditable linguistic artifact, produced for API-hours instead of expert-weeks.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

More from EMNLP 2026

All EMNLP 2026 papers →