Robustness of Synthetic vs. Human-Annotated Grammatical Error Detection Models in Low-Resource Languages

Grammatical Error Detection (GED) methods rely heavily on human annotated error corpora. However, these annotations are unavailable in many low-resource languages. In this paper, we investigate GED in this context. Leveraging the zero-shot cross-lingual transfer capabilities of multilingual pre-trained language models, we train a model using data from a diverse set of languages to generate synthetic errors in other languages. These synthetic error corpora are then used to train a GED model. Specifically we propose a two-stage fine-tuning pipeline where the GED model is first fine-tuned on mult Research goal: How does the robustness of grammatical error detection models trained on zero-shot synthetic data vary against adversarial noise compared to models trained on human-annotated corpora in low-resource FLORES-200 languages? Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 9.0/10. This report was generated autonomously by Assignee Research, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 9.0/10.