HumanEval+ Multilingual

Domaine:

natural language processing

Type de record:

dataset

Créateur:

lig

Hôte:

HumanEvalPlus_multilingual is a multilingual version of the benchmark HumanEval+, covering six languages: English, French, German, Spanish, Chinese, and Swahili. Each sample is a Python code generation problem from HumanEval+ (an extended version of OpenAI's HumanEval with 80x more tests), with the natural-language prompt translated into the five target languages.

Multilingual Translation with Extensible Multilingual Pretraining and Finetuning

Recent work demonstrates the potential of multilingual pretraining of creating one model that can be

AfriHealth-MultiLingual

Created with Adaptive Data by Adaption for the Uncharted Data Challenge AfriHealth-MultiLingual is

AIME24 Multilingual

aime24_multilingual is a multilingual version of the benchmark AIME 2024, covering six languages: En

Ccaligned Multilingual

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding

AIME25 Multilingual

aime25_multilingual is a multilingual version of the benchmark AIME 2025, covering six languages: En

Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models

Recently, it has been found that monolingual English language models can be used as knowledge bases. Instead of structural knowledge base queries, masked sentences such as "Paris is the capital of [MASK]" are used as probes. We translate the established benchmarks

HumanEval+ Multilingual

Domaine:

Type de record:

Visit

Languages

Tags