Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

Scaling of Source Languages and Cross-Lingual Transfer in Multi-Level Contrastive Models

Domain:

natural language processing

Record type:

paper
Creator:
Ass
Publisher:
Zenodo
Host:avatar
Multi-lingual language models (LM), such as mBERT, XLM-R, mT5, mBART, have been remarkably successful in enabling natural language tasks in low-resource languages through cross-lingual transfer from high-resource ones. In this work, we try to better understand how such models, specifically mT5, transfer *any* linguistic and semantic knowledge across languages, even though no explicit cross-lingual signals are provided during pre-training. Rather, only unannotated texts from each language are presented to the model separately and independently of one another, and the model appears to implicitly Research goal: What is the scaling relationship between the number of source languages in the training set and the cross-lingual transfer performance of multi-level contrastive models on low-resource slots in X-TREME-SLU? Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.5/10. This report was generated autonomously by Assignee Research, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 7.5/10.

Visit

doi.orgzenodo.org

Tasks

transfer learning

Tags

scalingrelationshipnumbersourcelanguagestrainingsetcross-lingual

Licenses

Creative Commons Attribution 4.0 Internationalhttps://creativecommons.org/licenses/by/4.0/legalcode

Similar

Comparing Source Language Selection Strategies for Multi-Source Cross-Lingual Transfer to African LanguagesMulti-Source Teacher-Student Models for Cross-Lingual NER in Low-Resource LanguagesMulti-source Intermediate-task Training for Robust Cross-lingual Transfer to Low-resource LanguagesScaling XLM-R Model Size and Zero-Shot Cross-Lingual Transfer Performance in MuCoT Contrastive TrainingPerformance Comparison of Budget-Xfer and Unconstrained Multi-Source Transfer Learning in Cross-Lingual NER on African LanguagesScaling Source Language Diversity in Multi-Source Cross-Lingual NER for Low-Resource WikiAnn Performance

Comparing Source Language Selection Strategies for Multi-Source Cross-Lingual Transfer to African Languages

Multi-Source Teacher-Student Models for Cross-Lingual NER in Low-Resource Languages

Cross-lingual Named Entity Recognition (NER) leverages knowledge transfer between languages to ident

Multi-source Intermediate-task Training for Robust Cross-lingual Transfer to Low-resource Languages

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Scaling XLM-R Model Size and Zero-Shot Cross-Lingual Transfer Performance in MuCoT Contrastive Training

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potentia

Performance Comparison of Budget-Xfer and Unconstrained Multi-Source Transfer Learning in Cross-Lingual NER on African Languages

Cross-lingual transfer learning enables NLP for low-resource languages by leveraging labeled data fr

Scaling Source Language Diversity in Multi-Source Cross-Lingual NER for Low-Resource WikiAnn Performance

To better tackle the named entity recognition (NER) problem on languages with little/no labeled data