8.6 Emerging

From voluntary framework to certifiable standard

Turning a voluntary risk-management framework into a certifiable standard, with a bar a tool can be checked against.

01

The impact of agents

Certifying a user-facing tool or agent requires a standard to certify against, and the standard has to say what passes and what does not. The risk-management frameworks that exist give a shared vocabulary and a sensible structure, but they are voluntary and set no threshold, so two builders can both claim to follow one and mean very different things.

Turning a framework into a defined, auditable standard, one a tool can pass or fail, is the step no jurisdiction has taken.

02

What must be verified

Government needs a certification regime that rests on a recognized risk-management structure but goes beyond it: a defined, auditable bar that means the same thing across jurisdictions, not just a shared vocabulary. The certifying body must run the assessment and maintain that auditable record.

03

Protecting access

An all-or-nothing standard excludes by pricing. The small builder for whom full assurance is out of reach stays uncertified, and their sound tool goes unused. Users who would have been best served by that tool are pushed toward whatever else met the bar.

Keeping the path open

  • Build graduated tiers on the same framework, so a low-risk tool can reach a meaningful, achievable level instead of failing the only bar on offer.
  • State each tier's meaning in plain language, so users can tell what 'certified' did and did not check.
  • Make the self-assessment workflow completable with a screen reader and keyboard alone, or a builder who relies on assistive technology can't reach the tier a low-risk tool would otherwise qualify for.
04

Response surface

Framework Assessment

A tiered self-assessment turns a tool's coverage of a risk-management framework into the certification level the framework itself leaves undefined.

DebtCalc Pro · certification readiness check
Each answer must cite evidence; the audit reviews any of it
Govern
A named owner is accountable for this tool’s risks, with authority to act
Map
Every use of the tool, and who it affects, is documented
Measure
Error rates and bias are measured on defined cases, on a schedule
Manage
Found risks get risk-based action, tracked to closure
Not ready. 3 of 4 functions evidenced.

Outcome the audit issues at this coverage: Provisional. At audit, partial coverage gets a provisional listing. The gaps are named in public, with a deadline to close them.

The framework names the discipline; the tiers make it enforceable. A readiness check that maps to a public pass/fail line is auditable. One that maps to nothing cannot be checked.

05

Maturity

Emerging

Emerging. Frameworks exist and are widely used, but they are voluntary, and no jurisdiction has yet implemented a mandatory, auditable certification regime for general-purpose civic technology tools based on them.

06

Precedents

The NIST AI Risk Management Framework (US). The framework organizes AI risk management around four functions: Govern, Map, Measure, and Manage. The Generative AI Profile addresses generative risks, supply-chain vulnerabilities, and third-party model assessment, and a Cyber AI Profile has reached an initial preliminary draft. The control overlays for AI remain announced and provisional.

The NIST AI Resource Center crosswalks. NIST states that the AI RMF 'is intended for voluntary use' and records that it 'is being revised'. Its AI Resource Center hosts crosswalks submitted by the framework's own user community, including one to ISO/IEC 42001, while stating that inclusion 'does not imply NIST endorsement' of the mapped resource. A crosswalk aligns vocabulary and sets no threshold, and the mapping toward a certifiable standard is being drawn by the user community rather than by the body that wrote the framework.

Australia's national AI assurance framework. The framework for AI assurance in government was agreed by Data and Digital Ministers, and the AI Plan for the Australian Public Service rests on three pillars: Trust covering transparency, ethics and governance, People covering capability building and engagement, and Tools covering access, infrastructure and support. Chief AI Officers are the named leadership mechanism for adoption.

ISO/IEC 42006, requirements for certification bodies. The standard sets what a body must satisfy to audit and certify an AI management system against ISO/IEC 42001, covering competence, impartiality, and audit duration. A voluntary framework becomes certifiable when the bodies assessing it are themselves accredited.

07

What carries over to agent use

High for risk-management structure; moderate as certification basis. The NIST RMF provides the vocabulary and structure a certification regime would assess against.

A government pattern library should treat the RMF (or its Australian equivalent) as the reference framework and define certification tiers on top of it. The Australian AI Assurance Framework is a useful precedent, having taken a government assurance framework toward exactly this kind of structured, accountable use.

08

Where things go wrong

The RMF's Govern/Map/Measure/Manage discipline (accountability for each AI use case and risk-based action) is exactly the assurance process a flawed automated decision lacks. Applied as a mandatory, auditable regime, it forces explicit ownership and measurement of the risk. A tool can satisfy the four functions on paper, governance documented, measurement logged, while no action follows when the numbers call for it. What catches that is auditing the self-assessment against the tool's actual practice, not accepting the completed assessment as the certification itself.

09

Sources

12 references US · Australia · International · EU (ETSI)