Skip to content
conftrace_
2026 EMNLP EMNLP 2026

GRAD: GRADient Rectification based on Authentic Data for Low-Resource Neural Machine Translation with Back Translation

AbstractSynthetic data augmentation, especially back-translation with Large Language Models (LLMs), has become a standard strategy for low-resource Neural Machine Translation (NMT). However, jointly training on synthetic and authentic data may suffer from conflicts. We propose GRADient Rectification based on Authentic Data (GRAD), an asymmetric gradient-level framework that treats authentic parallel data as an Authentic Anchor, and rectifies conflicting synthetic updates through orthogonal projection while preserving non-conflicting components. Furthermore, we leverage gradients of multiple authentic batch for comparison and use the most similar one for gradient rectification to alleviate information loss with the synthetic data. Experiments on six low-resource pairs across three LLM families (Qwen, Gemma, Llama) and different scales (4B/8B) show that GRAD consistently outperforms supervised fine-tuning, back-translation, and multi-stage baselines. Notably, on the lowest-resource En-Kk pair, GRAD achieves the highest COMET (83.65) among all evaluated systems. Further analysis shows that synthetic-induced gradient conflicts are localized, and parameter-wise rectification substantially outperforms global-wise rectification.

More from EMNLP 2026

All EMNLP 2026 papers →