Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

Monolingual and cross-lingual intent detection without training data in target languages

Domain:

natural language processing

Record type:

paper
Creator:
KapSalSka
Editor:
TilVytUniEur
Publisher:
CCSDMDPI
Host:avatar
International audience Due to recent DNN advancements, many NLP problems can be effectively solved using transformer-based models and supervised data. Unfortunately, such data is not available in some languages. This research is based on assumptions that (1) training data can be obtained by themachine translating it from another language; (2) there are cross-lingual solutions that work without the training data in the target language. Consequently, in this research, we use the English dataset and solve the intent detection problem for five target languages (German, French, Lithuanian, Latvian, and Portuguese). When seeking the most accurate solutions, we investigate BERT-based word and sentence transformers together with eager learning classifiers (CNN, BERT fine-tuning, FFNN) and lazy learning approach (Cosine similarity as the memory-based method). We offer and evaluate several strategies to overcome the data scarcity problem with machine translation, crosslingual models, and a combination of the previous two. The experimental investigation revealed the robustness of sentence transformers under various cross-lingual conditions. The accuracy equal to ~0.842 is achieved with the English dataset with completely monolingual models is considered ourtop-line. However, cross-lingual approaches demonstrate similar accuracy levels reaching ~0.831, ~0.829, ~0.853, ~0.831, and ~0.813 on German, French, Lithuanian, Latvian, and Portuguese languages.

Visit

inria.hal.science

Tasks

text classificationtransfer learning

Tags

LVPT languagesLTFRDEENmonolingual and cross-lingual experimentsword and sentence transformersBERT[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]

Licenses

info:eu-repo/semantics/OpenAccess

Similar

Hybrid Batch Training Effects on Monolingual vs. Cross-Lingual Retrieval in Low-Resource LanguagesHybrid Batch Training with Domain-Specific Monolingual Data for Zero-Shot Cross-Lingual Retrieval in Low-Resource LanguagesImpact of Target-Language Data in Intermediate Training on Zero-Shot Cross-Lingual Transfer for Low-Resource LanguagesCross-lingual vs. Monolingual Training Proportions in Zero-shot Retrieval for Low-resource African LanguagesScaling Cross-Lingual NER Performance with Unlabeled Target Data in Low-Resource LanguagesSimultaneous Monolingual and Cross-Lingual Training for Low-Resource Retrieval Scaling

Hybrid Batch Training Effects on Monolingual vs. Cross-Lingual Retrieval in Low-Resource Languages

Information retrieval across different languages is an increasingly important challenge in natural l

Hybrid Batch Training with Domain-Specific Monolingual Data for Zero-Shot Cross-Lingual Retrieval in Low-Resource Languages

Information retrieval across different languages is an increasingly important challenge in natural l

Impact of Target-Language Data in Intermediate Training on Zero-Shot Cross-Lingual Transfer for Low-Resource Languages

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Cross-lingual vs. Monolingual Training Proportions in Zero-shot Retrieval for Low-resource African Languages

Information retrieval across different languages is an increasingly important challenge in natural l

Scaling Cross-Lingual NER Performance with Unlabeled Target Data in Low-Resource Languages

To better tackle the named entity recognition (NER) problem on languages with little/no labeled data

Simultaneous Monolingual and Cross-Lingual Training for Low-Resource Retrieval Scaling

Information retrieval across different languages is an increasingly important challenge in natural l