Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

ChatGPT MT: Competitive for High- (but not Low-) Resource Languages

Domaine:

natural language processing

Type de record:

papermodel
Créateur:
RobOgaMorNeu
Hôte:avatar
Large language models (LLMs) implicitly learn to perform a range of language tasks, including machine translation (MT). Previous studies explore aspects of LLMs' MT capabilities. However, there exist a wide variety of languages for which recent LLM MT performance has never before been evaluated. Without published experimental evidence on the matter, it is difficult for speakers of the world's diverse languages to know how and whether they can use LLMs for their languages. We present the first experimental evidence for an expansive set of 204 languages, along with MT cost analysis, using the FLORES-200 benchmark. Trends reveal that GPT models approach or exceed traditional MT model performance for some high-resource languages (HRLs) but consistently lag for low-resource languages (LRLs), under-performing traditional MT for 84.1% of languages we covered. Our analysis reveals that a language's resource level is the most important feature in determining ChatGPT's relative ability to translate it, and suggests that ChatGPT is especially disadvantaged for LRLs and African languages. 27 pages, 9 figures, 14 tables

Visit

arxiv.org

Tasks

machine translation

Tags

Computation and Language

Similaires

Domain-specific MT for Low-resource Languages: The case of Bambara-FrenchHow Good is Zero-Shot MT Evaluation for Low Resource Indian Languages?Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languagestyracs18/low-resource-mtCombining Pretrained High-Resource Embeddings and Subword Representations for Low-Resource LanguagesNSL-MT: Linguistically Informed Negative Samples for Efficient Machine Translation in Low-Resource Languages

Domain-specific MT for Low-resource Languages: The case of Bambara-French

Translating to and from low-resource languages is a challenge for machine translation (MT) systems d

How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages?

While machine translation evaluation has been studied primarily for high-resource languages, there h

Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages

In an evolving landscape of crisis communication, the need for robust and adaptable Machine Translat

tyracs18/low-resource-mt

# In-Context Learning vs. Pivot-Based Translation for Low-Resource MT #### Overview This project co

Combining Pretrained High-Resource Embeddings and Subword Representations for Low-Resource Languages

The contrast between the need for large amounts of data for current Natural Language Processing (NLP) techniques, and the lack thereof, is accentuated in the case of African languages, most of which are considered low-resource. To help circumvent this issue, we exp

NSL-MT: Linguistically Informed Negative Samples for Efficient Machine Translation in Low-Resource Languages

We introduce negative space learning machine translation (NSL-MT), a training method for underresour