This dataset provides 44.4 hours of Ugandan English speech recordings (8,137 samples) from 59 Ugandan speakers living with speech impairments. The participants represent a diversity of progressive, acquired and congenital aetiologies, including cerebral palsy, Parkinson's disease, multiple sclerosis, autism spectrum disorder, Down syndrome, stroke and stuttering.