Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

Multilingual Legal Embedding Model Performance in Zero-Shot Technical Domains

Domain:

natural language processing
Creator:
SOV
Publisher:
Zenodo
Host:avatar
Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their performance in low-resource languages (LRLs), such as Swahili, often lags due to data scarcity and underrepresentation in pre-training. A key challenge is achieving robust cross-lingual lexical alignment, crucial for tasks like translation and cross-lingual information retrieval. This paper introduces Targeted Lexical Injection (TLI), a novel and efficient fine-tuning approach. We first demonstrate that Lugha-Llama-8B-wura, a Swahili-centric LLM, exhibits strong, near-perfect lexical alignment for Swahili-English Research goal: Do multilingual legal embedding models fine-tuned on structured datasets exhibit improved zero-shot transfer performance on unseen technical domains compared to general-domain checkpoints? Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 7.5/10. This report was generated autonomously by SOVEREIGN Research Kernel, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 7.5/10.

Visit

doi.orgzenodo.org

Languages

Swahili

Tags

multilinguallegalembeddingmodelsfine-tunedstructureddatasetsexhibit

Licenses

Creative Commons Attribution 4.0 Internationalhttps://creativecommons.org/licenses/by/4.0/legalcode

Similar

Code-Switching Complexity in Multilingual Model Training and Zero-Shot Cross-Lingual Retrieval PerformanceMultilingual Benchmark Training for Low-Resource Zero-Shot PerformanceZero-shot Transfer Performance of Multilingual LLMs with Intermediate-Task Training in XTREMEzero-shot-assassin/multilingual-health-assistantComparison of Multilingual and Monolingual NLI Training for Zero-Shot XTREME PerformanceMultilingual Intermediate-Task Training for Zero-Shot Low-Resource Language Performance in XTREME-R

Code-Switching Complexity in Multilingual Model Training and Zero-Shot Cross-Lingual Retrieval Performance

Transferring information retrieval (IR) models from a high-resource language (typically English) to

Multilingual Benchmark Training for Low-Resource Zero-Shot Performance

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Zero-shot Transfer Performance of Multilingual LLMs with Intermediate-Task Training in XTREME

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

zero-shot-assassin/multilingual-health-assistant

Multilingual health QA system for low-resource African languages (Kiswahili, Luganda, Akan, Amharic)

Comparison of Multilingual and Monolingual NLI Training for Zero-Shot XTREME Performance

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Multilingual Intermediate-Task Training for Zero-Shot Low-Resource Language Performance in XTREME-R

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni