Developing a Data Lakehouse for a South African Government-Sector Training Authority

The Durban University of Technology is undertaking a project to develop a data lakehouse system for a South African government-sector training authority. This system is considered critical to enhance the monitoring and evaluation capabilities of the training authority and ensure service delivery. Key to the successful deployment of the data lakehouse is the implementation of suitable data governance for the system. This chapter identifies the key components of data governance relevant to the system through a systematic literature review process. Thereafter, the components of data governance are mapped against the technical architecture of the data lakehouse and the governance mechanisms are for all lakehouse system components are defined. A practitioner expert evaluation is presented to assess the data governance mechanisms. Overall, the data governance framework and resulting mechanisms were found to be sufficient, except regarding ensuring data quality. The need for separate studies focused on ensuring data quality for the data lakehouse system was identified as future work.