Logo Lanfrica

Plum165/Global-South-AI-Safety-Hackathon

Domaine:

natural language processing

Type de record:

softwareproject
Créateur:
Plu
Hôte:
AI Safety Observatory for Africa is a full-stack platform that evaluates and visualises the safety of large language models across African languages, AI risk categories, and different model architectures. Built for the Global South AI Safety Hackathon, it identifies potential safety gaps where harmful prompts in languages such as isiZulu, Afrikaans # AI Safety Observatory for Africa A full-stack platform that evaluates, monitors, and visualises the safety of Large Language Models (LLMs) across African languages, risk categories, and commercial/open-source model architectures — built for the Global South AI Safety Hackathon. --- ## What It Does Most LLM safety guardrails are trained and tested primarily on English data. This observatory exposes the gap: harmful prompts in Swahili, isiZulu, Afrikaans, Shona, Yoruba, and Amharic can bypass safeguards that correctly block the same content in English. The platform provides: - Real-time safety scoring of prompts and responses across 4 AI models - Per-language safety comparison (English vs African languages) - Adversarial benchmark evaluation (30-prompt HarmBench suite) - Jailbreak detection with live classification - AI "Vibe Report" — trust and confidence metrics for judges --- ## Repository Structure ``` ├── assets/ Static assets (images, datasets) ├── demo/ Demo video, presentation, overview ├── docs/ │ ├── SETUP.md Installation and run instructions │ ├── USAGE.md How to use the dashboard │ ├── TEAM.md Team members and roles │ └── ACKNOWLEDGEMENTS.md Third-party libraries and references ├── scripts/ Utility and automation scripts ├── src/ │ ├── backend/ Express.js API — routes, services, providers, analytics, db │ ├── frontend/ React + TypeScript + Vite dashboard │ ├── package.json Unified dependencies │ └── README.md Full architecture reference ├── vendor/ Self-included third-party modules ├── Dockerfile Multi-stage Node 20 Alpine production build ├── render.yaml One-click Render.com deployment config ├── .dockerignore ├── .gitignore └── LICENSE ``` --- ## Tech Stack | Layer | Technology | |---|---| | Frontend | React 18, TypeScript, Vite, Tailwind CSS v4, Rechar …