Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Comparative Analysis of Cross-Lingual Transfer in Multilingual Versus Monolingual Models on Domain-Specific Benchmarks

Domaine:

natural language processing

Type de record:

paper
Créateur:
Ass
Éditeur:
Zenodo
Hôte:avatar
This paper shows that pretraining multilingual language models at scale leads to significant performance gains for a wide range of cross-lingual transfer tasks. We train a Transformer-based masked language model on one hundred languages, using more than two terabytes of filtered CommonCrawl data. Our model, dubbed XLM-R, significantly outperforms multilingual BERT (mBERT) on a variety of cross-lingual benchmarks, including +14.6\% average accuracy on XNLI, +13\% average F1 score on MLQA, and +2.4\% F1 score on NER. XLM-R performs particularly well on low-resource languages, improving 15.7\% in XNL Research goal: How does the cross-lingual transfer performance of multilingual models compare to monolingual models when evaluated on domain-specific benchmarks beyond MKQA, such as XNLI or PAWS-X, focusing on F1 score and accuracy metrics? Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.7/10. This report was generated autonomously by Assignee Research, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 8.7/10.

Visit

doi.orgzenodo.org

Tasks

transfer learning

Tags

cross-lingualtransferperformancemultilingualmodelsmonolingualevaluateddomain-specific

Licenses

Creative Commons Attribution 4.0 Internationalhttps://creativecommons.org/licenses/by/4.0/legalcode

Similaires

Comparative Analysis of Multilingual and Monolingual Intermediate-Task Training for Zero-Shot Cross-Lingual Transfer inComparative Analysis of Multilingual versus English-Only Intermediate Training for Zero-Shot Cross-Lingual Transfer on XTREME-RComparative Analysis of Zero-Shot Cross-Lingual Transfer in 10B versus 1B Parameter Models on XTREME-R NLI TasksComparative Analysis of English versus Multilingual Intermediate-Task Training for Zero-Shot Cross-Lingual Transfer in XTREME-RCross-lingual transfer of multilingual models on low resource African LanguagesPerformance of Multilingual Dense Retrieval Models on WebFAQ Benchmarks with Cross-Lingual Contrastive Learning

Comparative Analysis of Multilingual and Monolingual Intermediate-Task Training for Zero-Shot Cross-Lingual Transfer in

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Comparative Analysis of Multilingual versus English-Only Intermediate Training for Zero-Shot Cross-Lingual Transfer on XTREME-R

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Comparative Analysis of Zero-Shot Cross-Lingual Transfer in 10B versus 1B Parameter Models on XTREME-R NLI Tasks

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potentia

Comparative Analysis of English versus Multilingual Intermediate-Task Training for Zero-Shot Cross-Lingual Transfer in XTREME-R

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Cross-lingual transfer of multilingual models on low resource African Languages

Large multilingual models have significantly advanced natural language processing (NLP) research. Ho

Performance of Multilingual Dense Retrieval Models on WebFAQ Benchmarks with Cross-Lingual Contrastive Learning

We present WebFAQ, a large-scale collection of open-domain question answering datasets derived from