Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Zero-shot Cross-lingual Transfer Performance of mT5 and Bloom in Synthetic Error Generation for Low-resource Languages

Domaine:

natural language processing

Type de record:

paper
Créateur:
Ass
Éditeur:
Zenodo
Hôte:avatar
Grammatical Error Detection (GED) methods rely heavily on human annotated error corpora. However, these annotations are unavailable in many low-resource languages. In this paper, we investigate GED in this context. Leveraging the zero-shot cross-lingual transfer capabilities of multilingual pre-trained language models, we train a model using data from a diverse set of languages to generate synthetic errors in other languages. These synthetic error corpora are then used to train a GED model. Specifically we propose a two-stage fine-tuning pipeline where the GED model is first fine-tuned on mult Research goal: How does the zero-shot cross-lingual transfer performance of models like mT5 or Bloom compare when generating synthetic errors for low-resource languages, as measured by F0.5 scores on the CoNLL-2014 shared task for GED? Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 9.3/10. This report was generated autonomously by Assignee Research, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 9.3/10.

Visit

doi.orgzenodo.org

Tasks

grammar error correctiontransfer learning

Tags

zero-shotcross-lingualtransferperformancemodelslikemT5Bloom

Licenses

Creative Commons Attribution 4.0 Internationalhttps://creativecommons.org/licenses/by/4.0/legalcode

Similaires

Scaling Zero-Shot Cross-Lingual Transfer for Synthetic Error Data Generation in Low-Resource LanguagesScaling Model Size and Zero-Shot Cross-Lingual Transfer Performance in Low-Resource LanguagesDomain Similarity Impact on Zero-Shot Cross-Lingual Transfer Performance in Low-Resource LanguagesImpact of Intermediate Task Order on Zero-Shot Cross-Lingual Transfer Performance for Low-Resource LanguagesOptimal Transport Distillation for Cross-Lingual Zero-Shot Transfer in Low-Resource LanguagesSynthetic Query Augmentation for Zero-Shot Cross-Lingual Dense Retrieval in Low-Resource Languages

Scaling Zero-Shot Cross-Lingual Transfer for Synthetic Error Data Generation in Low-Resource Languages

Grammatical Error Detection (GED) methods rely heavily on human annotated error corpora. However, th

Scaling Model Size and Zero-Shot Cross-Lingual Transfer Performance in Low-Resource Languages

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potentia

Domain Similarity Impact on Zero-Shot Cross-Lingual Transfer Performance in Low-Resource Languages

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Impact of Intermediate Task Order on Zero-Shot Cross-Lingual Transfer Performance for Low-Resource Languages

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Optimal Transport Distillation for Cross-Lingual Zero-Shot Transfer in Low-Resource Languages

Benefiting from transformer-based pre-trained language models, neural ranking models have made signi

Synthetic Query Augmentation for Zero-Shot Cross-Lingual Dense Retrieval in Low-Resource Languages

Multilingual Pretrained Language Models (MPLMs) perform strongly in cross-lingual transfer. We propo