Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

manifold-machines/synglot

Domaine:

natural language processing

Type de record:

software
Créateur:
man
Hôte:
Synthetic data generation and translation tools for low-resource languages. # Synglot: Comprehensive Synthetic Data Generation and Translation Toolkit > [!NOTE] > This project is currently under development. Many features may break and the generation functionality is not fully implemented. Features and APIs may change without notice. Use with caution. You're welcome to contribute! `Synglot` is a Python NLP toolkit for bulk machine translation, synthetic data generation, and multilingual dataset management. The goal is to make it extremely simple to bulk translate datasets in new languages, as well as synthetically generate new ones, in order to empower NLP research in low-resource languages. ## Roadmap - implement further throttling to the OpenAI translator to avoid enqueued token limits, as well as TPD limits. - add sentence splitting to the NLLB backend for higher quality. - integrate the PDF scripts into the core Synglot library - refactor and implement real generation functionality - ✅ add OpenRouter support for more providers ## Key Features - **Unified Translation**: Multi-backend translation supporting MarianMT, NLLB, OpenAI, Google Translate, and OpenRouter APIs - **Generation**: Synthetic data generation with HuggingFace and OpenAI backends - **Powerful Dataset Management**: Comprehensive dataset handling with pandas-like operations - **Batch Processing**: Process many examples at once with optimized performance (especially NLLB) - **CLI Interface**: Full command-line interface for all operations ## Installation ### Basic Installation ```bash git clone github.com cd synglot # Install uv package manager if needed curl -LsSf astral.sh | sh uv venv source .venv/bin/activate uv sync ``` ### Backend Dependencies #### For OpenAI Support ```bash pip install openai export OPENAI_API_KEY="your-openai-api-key" ``` #### For Google Translate Support ```bash pip install google-cloud-translate export GOOGLE_CLOUD_PROJECT_ID="your-project-id" # Set up authentication (see C …

Visit

github.com

Tasks

machine translation

Licenses

MIT

Similaires

EJSAHN/sorghum-seed-spectral-manifoldManifold Characteristics That Predict Downstream Task PerformanceNon-Linear Manifold Scoring Narrows Multilingual Open QA Resource GapsRiemannian Manifold Metrics Improve mDPR Retrieval Accuracy in Low-Resource LanguagesA DILAPIDATED WISDOM: HISTORICAL RETROSPECTION ON THE MANIFOLD CAREER OF HERBALIST-HEALERSManifold adaptation for constant false alarm rate ship detection in South African oceans

EJSAHN/sorghum-seed-spectral-manifold

Analysis pipeline for the Senegal sorghum seed spectral manifold and hyperspectral GWAS, including i

Manifold Characteristics That Predict Downstream Task Performance

Manifold Characteristics That Predict Downstream Task Performance

Poster presented at the Deep Learning Indaba 2022 by Ruan van der Merwe

Non-Linear Manifold Scoring Narrows Multilingual Open QA Resource Gaps

This report synthesises findings from 6 peer-reviewed papers addressing the following research quest

Riemannian Manifold Metrics Improve mDPR Retrieval Accuracy in Low-Resource Languages

This report synthesises findings from 5 peer-reviewed papers addressing the following research quest

A DILAPIDATED WISDOM: HISTORICAL RETROSPECTION ON THE MANIFOLD CAREER OF HERBALIST-HEALERS

Based on local Amharic and Ge'ez medical manuscripts and secondary source materials, along with a wi

Manifold adaptation for constant false alarm rate ship detection in South African oceans

The detection of ships at sea is a difficult task made more so by uncooperative ships, especially wh