We report observations of three high-frequency-peaked BL Lac objects (HBL) in 2003 and 2004 with the H.E.S.S. stereoscopic array of imaging atmospheric-Cherenkov telescopes in Namibia. We present the discovery of very high energy (VHE) gamma-ray emission from PKS 2005-489 (z=0.071) and the detection of VHE emission from PKS 2155-304 (z=0.117) and Mkn 421 (z=0.031). A spectral characterisation is presented in each case.