MEASURING RULE OF LAW THROUGH DOCUMENTARY EVIDENCE: A Seven-Category Methodology Applied to South African Government Gazette Data, 2008–2024

Rule of law measurement remains dominated by perception-based indices that aggregate expert and household survey responses into composite governance scores. While valuable, these approaches share a structural limitation: they measure how governance is experienced rather than what governance produces. This paper presents a documentary methodology that addresses this gap — measuring Rule of law compliance directly from official governance instruments rather than from observer perception. The methodology applies seven operational categories to government gazette entries to assess whether each instrument meets the minimum documentary requirements for actionability: whether those subject to it can identify the issuer and legal basis (Authority), understand its requirements (Clarity), determine when it takes effect (Commencement), locate and retrieve it (Publication), participate in its making where required (Public Participation), identify the legislation it operates under (Referent), and determine whether it applies to them (Jurisdiction). These categories are derived from a single foundational claim — that for a law to govern behaviour it must be actionable by those subject to it — and are exhaustive of the documentary requirements for actionability as operationalised in this paper. Each category resolves primarily to a question of fact verifiable on the face of the instrument. Applied to 28,337 South African national and provincial gazette entries spanning 2008 to 2024, the methodology identifies 8,579 entries containing at least one category failure — a 30.3% failure rate. Inter-rater reliability is measured at Cohen's Kappa 0.655. External validation against Auditor-General irregular expenditure data yields r = -0.852 (p = 0.0004) over twelve matched years, confirming that the documentary compliance measure captures governance failure patterns independently recorded by a separate audit process. The temporal findings document a sharp deterioration in documentary compliance from 2015 corresponding to the independently documented South African state capture period, with partial recovery from 2021. The methodology offers, by construction, what perception-based measurement cannot: objective, datable, continuous documentary records capable of detecting governance deterioration in real time and before it becomes visible in institutional outcomes. Keywords: Rule of law measurement; Documentary compliance; Government gazette; Content analysis; South Africa; State capture