Governance documentation being reviewed
KESHO PARTNERSAll insights

AI governance

The minimum viable AI governance pack: eight artifacts before production

A practical operating pack that connects AI ownership, risk, evaluation, human oversight, release decisions, and monitoring.

By Kesho Partners

11 minute read

Before a consequential AI system enters production, the organization should be able to produce eight connected artifacts: an AI register, system card, impact assessment, control map, evaluation report, human-oversight procedure, release decision record, and monitoring and incident plan. Together they show what the system does, who owns it, how it was tested, which risks remain, and how people will respond when conditions change.

Governance becomes real when it leaves evidence

Principles such as fairness, transparency, safety, and accountability are useful direction, but a product team cannot release against a principle alone. It needs named decisions, evidence, thresholds, owners, and procedures connected to the system being built.

NIST organizes AI risk management around Govern, Map, Measure, and Manage. ISO/IEC 42001 defines requirements for an organizational AI management system. The EU AI Act applies obligations according to role and risk. The eight artifacts below do not replace any framework or legal assessment; they create an operational spine that can map to each one.

Sources: [1], [2], [3], [4]

The eight artifacts

Keep each artifact proportionate. A low-impact internal assistant does not need the same review depth as a system influencing access to employment, credit, healthcare, or critical infrastructure. The important property is traceability: every control and test should connect back to an intended use and identified risk.

Minimum viable AI governance pack
ArtifactDecision it supportsMinimum contents
1. AI registerWhat AI exists and who owns it?System, purpose, owner, users, data, models, vendors, status, materiality
2. System cardWhat exactly is being released?Intended use, boundaries, architecture, users, limitations, prohibited use
3. Impact assessmentWho or what could be affected?Benefits, affected groups, failure modes, severity, likelihood, residual risk
4. Control mapHow is each material risk reduced?Preventive, detective, corrective controls; owner; evidence; review frequency
5. Evaluation reportDoes performance meet the agreed threshold?Dataset, metrics, scenarios, results, errors, robustness, approvals
6. Human-oversight procedureWhen and how can a person intervene?Review points, authority, context, override, escalation, appeal
7. Release decisionWho accepted the remaining risk?Version, evidence reviewed, exceptions, conditions, approvers, expiry
8. Monitoring and incident planHow will change or harm be detected and handled?Signals, thresholds, alerts, response, reporting, rollback, review

Sources: [1], [2], [3]

Start with the register and system card

An organization cannot govern systems it cannot identify. The AI register should include internally built systems, embedded vendor features, models used through APIs, automated decisions, and material experiments approaching production. Assign a business owner and technical owner rather than listing a committee as accountable.

The system card is the stable description of one deployed system. It should state the intended purpose, users, boundaries, data flows, model and vendor dependencies, prohibited uses, and known limitations. Update it when a change could alter behavior or risk, not for every cosmetic release.

A procurement inventory is not automatically an AI inventory. AI can enter through product updates, embedded SaaS features, internal experiments, and model APIs charged to general cloud accounts.

Connect impact assessment directly to controls

The impact assessment should describe plausible consequences in the actual workflow: an incorrect recommendation, disclosure of sensitive information, discriminatory treatment, unsafe automation, inability to explain a decision, service interruption, or dependence on a provider the organization cannot replace.

For every material risk, the control map should identify a control owner and the evidence that proves the control operates. A policy statement is not evidence that access restrictions, evaluation gates, human review, or incident procedures work in production.

Prevent
Reduce the chance of failure through data controls, permission boundaries, design constraints, secure architecture, and prohibited-use rules.
Detect
Use evaluation, logs, monitoring, user reporting, and review sampling to identify failure or material change.
Correct
Define fallback behavior, rollback, human intervention, customer remedy, incident handling, and model or vendor replacement.

Sources: [1], [2], [4]

Make the release decision explicit

Evaluation should use representative tasks, data, languages, user groups, and operating conditions. Record the baseline, thresholds, known gaps, security tests, and performance by meaningful subgroup where relevant. A single average score can hide the failure that matters most.

The release record identifies who reviewed the evidence and who accepted residual risk. Conditional approval should name the condition, owner, deadline, and operational restriction. Approval should expire when the system, model, data, intended use, or risk materially changes.

Sources: [1], [2], [3]

Human oversight needs authority, information, and time

A person is not meaningful oversight if they cannot understand the recommendation, access supporting context, override the result, pause the workflow, or escalate before harm occurs. Define which decisions require review and measure whether reviewers actually intervene when needed.

Production monitoring should cover more than uptime. Track task quality, error patterns, drift, security events, costs, escalation volume, override rates, complaints, and downstream outcomes. The incident plan should state when to restrict, roll back, notify, investigate, and reassess the system.

Sources: [2], [3]

Use one governance cadence across product and risk

The eight artifacts should be produced through existing discovery, architecture, security, procurement, release, and incident processes wherever possible. A separate governance lane creates duplicate meetings and late surprises.

Review higher-risk systems at defined intervals and after material changes. Review lower-risk systems by exception and automated monitoring. The objective is not equal paperwork for every use case; it is reliable evidence that the organization understands and controls the AI it operates.

Related service

AI governance and assurance

Kesho helps organizations turn AI principles, risk frameworks, and obligations into controls that product, engineering, risk, and business teams can operate.

Explore the service