Logo Lanfrica

masakhane-io/afriscience_mt

Domain:

natural language processing

Record type:

softwaredataset
Creator:
mas
Host:
AfriScience-MT: Towards Decolonizing Science in Africa through Text Translation (ACL 2026) # AfriScience-MT Single-CLI machine-translation framework for African scientific text. Harmonizes result schemas across all experiment types (zero-shot, seq2seq fine-tune, LoRA fine-tune, LLM zero-shot / ICL / document-level), and reproduces every table and figure in the accompanying paper from a single aggregated CSV. - **Code (this repo):** the `afriscience-mt` CLI, training/inference/eval pipelines, and the `afriscience_mt.paper` modules that rebuild every paper table and figure. - **Data and predictions:** Hugging Face, `masakhane/afriscience_mt`. - **Paper:** AfriScience-MT: Towards Decolonizing Science in Africa through Text Translation (arXiv:2605.29741). - **License:** Apache-2.0 (see `LICENSE`). ## Hugging Face dataset The parallel corpus and every evaluation prediction live in one HF dataset repo, exposed as four configurations: ```python from datasets import load_dataset # (1) Parallel scientific corpus -- English + six African targets # (amh, hau, lug, nso, yor, zul), 11 domains, sentence- and # document-aligned. Default configuration. corpus = load_dataset("masakhane/afriscience_mt", "corpus") corpus["train"], corpus["dev"], corpus["test"] # (2) Per-sentence model outputs for every system we evaluate # (four seq2seq, seven open-weight LLMs, four closed models) across # zero-shot, in-context-learning, and document-level configurations. preds = load_dataset("masakhane/afriscience_mt", "predictions") preds["outputs"] # one row per (model, config, lang_pair, sentence_id) # (3) Per-run aggregated metrics that drive every paper table. metrics = load_dataset("masakhane/afriscience_mt", "metrics") metrics["summary"] # one row per (model, config, lang_pair): chrF, COMET, BLEU # (4) Co-developed bilingual scientific glossaries. gloss = load_dataset("masakhane/afriscience_mt", "glossary") gloss["terms"] # one row per (target_lang, eng term, target translation) ``` Every `outputs` row carries enough metadata to join back to the test …