Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Word Alignment Integration in Cross-Lingual Sentence Embeddings for XNLI Zero-Shot Transfer

Domaine:

natural language processing

Type de record:

paper
Créateur:
Ass
Éditeur:
Zenodo
Hôte:avatar
We propose a new approach for learning contextualised cross-lingual word embeddings based on a small parallel corpus (e.g. a few hundred sentence pairs). Our method obtains word embeddings via an LSTM encoder-decoder model that simultaneously translates and reconstructs an input sentence. Through sharing model parameters among different languages, our model jointly trains the word embeddings in a common cross-lingual space. We also propose to combine word and subword embeddings to make use of orthographic similarities across different languages. We base our experiments on real-world data from Research goal: How does the integration of word alignment techniques impact the performance of cross-lingual sentence embeddings on the XNLI benchmark when evaluated through zero-shot transfer accuracy in low-resource languages compared to high-resource languages? Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.9/10. This report was generated autonomously by Assignee Research, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 7.9/10.

Visit

doi.org

Tasks

embeddings

Tags

integrationwordalignmenttechniquesimpactperformancecross-lingualsentence

Licenses

Creative Commons Attribution 4.0 Internationalhttps://creativecommons.org/licenses/by/4.0/legalcode

Similaires

Early-Layer LoRA Fine-Tuning for Lexical Alignment in Lugha-Llama: Zero-Shot Cross-Lingual Transfer Accuracy on XNLI forDomain-Specific Intermediate Tasks and Zero-Shot Cross-Lingual Transfer in XNLIArtificially Code-Switched Data for Cross-Lingual Embedding Alignment in Low-Resource Zero-Shot XNLI SettingsZero-Shot Transfer Learning using Affix and Correlated Cross-Lingual Embeddings.Multimodal Alignment Tasks and Zero-Shot Cross-Lingual Transfer in XLM-RCross-lingual Data Augmentation versus Multilingual Transfer Learning for Zero-shot XNLI Performance in Low-resource Languages

Early-Layer LoRA Fine-Tuning for Lexical Alignment in Lugha-Llama: Zero-Shot Cross-Lingual Transfer Accuracy on XNLI for

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their performance in low

Domain-Specific Intermediate Tasks and Zero-Shot Cross-Lingual Transfer in XNLI

Zero-shot cross-lingual transfer is a central task in multilingual NLP, allowing models trained in l

Artificially Code-Switched Data for Cross-Lingual Embedding Alignment in Low-Resource Zero-Shot XNLI Settings

Transferring information retrieval (IR) models from a high-resource language (typically English) to

Zero-Shot Transfer Learning using Affix and Correlated Cross-Lingual Embeddings.

Learning morphologically supplemented embedding spaces using cross-lingual models has become an acti

Multimodal Alignment Tasks and Zero-Shot Cross-Lingual Transfer in XLM-R

The introduction of pretrained cross-lingual language models brought decisive improvements to multil

Cross-lingual Data Augmentation versus Multilingual Transfer Learning for Zero-shot XNLI Performance in Low-resource Languages

While natural language processing systems often focus on a single language, multilingual transfer le