Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Layer-wise Feature Aggregation and Fine-tuning for Zero-shot Cross-lingual Performance in XTREME-R

Domaine:

natural language processing
Créateur:
Ass
Éditeur:
Zenodo
Hôte:avatar
Euphemisms are culturally variable and often ambiguous, posing challenges for language models, especially in low-resource settings. This paper investigates how cross-lingual transfer via sequential fine-tuning affects euphemism detection across five languages: English, Spanish, Chinese, Turkish, and Yoruba. We compare sequential fine-tuning with monolingual and simultaneous fine-tuning using XLM-R and mBERT, analyzing how performance is shaped by language pairings, typological features, and pretraining coverage. Results show that sequential fine-tuning with a high-resource L1 improves L2 perfo Research goal: How does the combination of layer-wise feature aggregation and fine-tuning on a high-resource language (e.g., English) affect zero-shot cross-lingual performance on low-resource languages in XTREME-R, compared to using only the last layer? Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.7/10. This report was generated autonomously by Assignee Research, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 8.7/10.

Visit

doi.org

Tasks

text classificationtransfer learning

Languages

Yoruba

Tags

combinationlayer-wisefeatureaggregationfine-tuninghigh-resourcelanguageEnglish

Licenses

Creative Commons Attribution 4.0 Internationalhttps://creativecommons.org/licenses/by/4.0/legalcode

Similaires

Sequential Fine-Tuning Task Quantity and Zero-Shot Cross-Lingual Transfer in XTREME-RContrastive-Adversarial Fine-Tuning for Zero-Shot Cross-Lingual Performance in XLM-RSequence of Intermediate-Task Fine-Tuning and Zero-Shot Cross-Lingual Performance on XTREME-R with Adversarial PerturbationsFine-tuning Impact on Zero-shot XTREME-R Performance in Low-resource LanguagesComparative Analysis of Multilingual and English-Only Intermediate Fine-Tuning for Zero-Shot Cross-Lingual Transfer on XTREME-RGradient Clipping Thresholds in XLM-R Fine-Tuning for Zero-Shot Cross-Lingual Transfer

Sequential Fine-Tuning Task Quantity and Zero-Shot Cross-Lingual Transfer in XTREME-R

Euphemisms are culturally variable and often ambiguous, posing challenges for language models, espec

Contrastive-Adversarial Fine-Tuning for Zero-Shot Cross-Lingual Performance in XLM-R

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potentia

Sequence of Intermediate-Task Fine-Tuning and Zero-Shot Cross-Lingual Performance on XTREME-R with Adversarial Perturbations

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potentia

Fine-tuning Impact on Zero-shot XTREME-R Performance in Low-resource Languages

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Comparative Analysis of Multilingual and English-Only Intermediate Fine-Tuning for Zero-Shot Cross-Lingual Transfer on XTREME-R

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Gradient Clipping Thresholds in XLM-R Fine-Tuning for Zero-Shot Cross-Lingual Transfer

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potentia