AI is reshaping governance in Kenya, not only through bias and misinformation but through a deeper process of algorithmic colonialism, where external technologies distort African languages and political realities. Due to limited linguistic coverage and foreign dominance in digital infrastructure, AI systems undermine epistemic access and democratic participation. This paper argues for a Pan-African AI Sovereignty Agency to build sovereign AI hubs, cultural data libraries, and public foundation models, enabling the continent to reclaim algorithmic sovereignty and ensure epistemic autonomy.