||Multi-modal electoral misinformation detection for Nigeria using AASIST audio deepfake detection, YOLOv8 INEC document forgery analysis and XLM-RoBERTa 5-language classification for INEC and fact-checkers.
# Electoral Misinformation Detection, Nigeria
> Multi-modal AI system detecting audio deepfakes, fabricated INEC documents, and fake news text in Nigerian English, Pidgin, Yoruba, Hausa, and Igbo, built for INEC, fact-checkers, and civil society ahead of Nigeria's election cycles. Trained on actual 2023 election misinformation patterns.
---
## The Problem
Nigeria's 2023 general elections were flooded with:
- **AI-generated audio deepfakes** of presidential candidates making fabricated statements
- **Forged INEC result sheets** and press releases declaring fictional vote tallies
- **Coordinated WhatsApp campaigns** sharing fake INEC announcements before counting was complete
- **Fabricated court orders** purporting to halt elections in specific states
No real-time detection system existed for Nigerian electoral context. The result: genuine public confusion, voter suppression, and incidents of post-election violence traceable to misinformation spread.
---
## Solution: Three-Modality Detection Pipeline
| Module | Technology | Target |
|---|---|---|
| **Audio Deepfake** | AASIST (spectro-temporal graph attention) | Fake candidate speech, voice cloning |
| **Document Forgery** | YOLOv8 + BERT + PaddleOCR | Fake INEC result sheets, court orders |
| **Multilingual Fake News** | XLM-RoBERTa (5 languages) | WhatsApp/social media fake text |
---
## Language Coverage
| Language | Speakers (Nigeria) | Model Approach |
|---|---|---|
| Nigerian English | 100M+ | Fine-tuned XLM-R |
| Nigerian Pidgin | 75M+ | Fine-tuned XLM-R |
| Hausa | 63M | Fine-tuned XLM-R |
| Yoruba | 45M | Fine-tuned XLM-R |
| Igbo | 35M | Fine-tuned XLM-R |
---
## Stakeholder Integration
- **INEC**: Automated monitoring of social media mentions of INEC + real-time forgery alerts
- **Dubawa / AFP Nigeria**: API endpoint for submitting content for fact-check triage
- **WhatsApp bot**: Public submission, forward suspicious message → verdict in < 60 seconds
- **Election observers** (EU, AU, EC …