
AI governance
The minimum viable AI governance pack: eight artifacts before production
A practical operating pack that connects AI ownership, risk, evaluation, human oversight, release decisions, and monitoring.
By Kesho Partners
11 minute read
Before a consequential AI system enters production, the organization should be able to produce eight connected artifacts: an AI register, system card, impact assessment, control map, evaluation report, human-oversight procedure, release decision record, and monitoring and incident plan. Together they show what the system does, who owns it, how it was tested, which risks remain, and how people will respond when conditions change.
Governance becomes real when it leaves evidence
Principles such as fairness, transparency, safety, and accountability are useful direction, but a product team cannot release against a principle alone. It needs named decisions, evidence, thresholds, owners, and procedures connected to the system being built.
NIST organizes AI risk management around Govern, Map, Measure, and Manage. ISO/IEC 42001 defines requirements for an organizational AI management system. The EU AI Act applies obligations according to role and risk. The eight artifacts below do not replace any framework or legal assessment; they create an operational spine that can map to each one.
The eight artifacts
Keep each artifact proportionate. A low-impact internal assistant does not need the same review depth as a system influencing access to employment, credit, healthcare, or critical infrastructure. The important property is traceability: every control and test should connect back to an intended use and identified risk.
| Artifact | Decision it supports | Minimum contents |
|---|---|---|
| 1. AI register | What AI exists and who owns it? | System, purpose, owner, users, data, models, vendors, status, materiality |
| 2. System card | What exactly is being released? | Intended use, boundaries, architecture, users, limitations, prohibited use |
| 3. Impact assessment | Who or what could be affected? | Benefits, affected groups, failure modes, severity, likelihood, residual risk |
| 4. Control map | How is each material risk reduced? | Preventive, detective, corrective controls; owner; evidence; review frequency |
| 5. Evaluation report | Does performance meet the agreed threshold? | Dataset, metrics, scenarios, results, errors, robustness, approvals |
| 6. Human-oversight procedure | When and how can a person intervene? | Review points, authority, context, override, escalation, appeal |
| 7. Release decision | Who accepted the remaining risk? | Version, evidence reviewed, exceptions, conditions, approvers, expiry |
| 8. Monitoring and incident plan | How will change or harm be detected and handled? | Signals, thresholds, alerts, response, reporting, rollback, review |
Start with the register and system card
An organization cannot govern systems it cannot identify. The AI register should include internally built systems, embedded vendor features, models used through APIs, automated decisions, and material experiments approaching production. Assign a business owner and technical owner rather than listing a committee as accountable.
The system card is the stable description of one deployed system. It should state the intended purpose, users, boundaries, data flows, model and vendor dependencies, prohibited uses, and known limitations. Update it when a change could alter behavior or risk, not for every cosmetic release.
A procurement inventory is not automatically an AI inventory. AI can enter through product updates, embedded SaaS features, internal experiments, and model APIs charged to general cloud accounts.
Connect impact assessment directly to controls
The impact assessment should describe plausible consequences in the actual workflow: an incorrect recommendation, disclosure of sensitive information, discriminatory treatment, unsafe automation, inability to explain a decision, service interruption, or dependence on a provider the organization cannot replace.
For every material risk, the control map should identify a control owner and the evidence that proves the control operates. A policy statement is not evidence that access restrictions, evaluation gates, human review, or incident procedures work in production.
- Prevent
- Reduce the chance of failure through data controls, permission boundaries, design constraints, secure architecture, and prohibited-use rules.
- Detect
- Use evaluation, logs, monitoring, user reporting, and review sampling to identify failure or material change.
- Correct
- Define fallback behavior, rollback, human intervention, customer remedy, incident handling, and model or vendor replacement.
Make the release decision explicit
Evaluation should use representative tasks, data, languages, user groups, and operating conditions. Record the baseline, thresholds, known gaps, security tests, and performance by meaningful subgroup where relevant. A single average score can hide the failure that matters most.
The release record identifies who reviewed the evidence and who accepted residual risk. Conditional approval should name the condition, owner, deadline, and operational restriction. Approval should expire when the system, model, data, intended use, or risk materially changes.
Human oversight needs authority, information, and time
A person is not meaningful oversight if they cannot understand the recommendation, access supporting context, override the result, pause the workflow, or escalate before harm occurs. Define which decisions require review and measure whether reviewers actually intervene when needed.
Production monitoring should cover more than uptime. Track task quality, error patterns, drift, security events, costs, escalation volume, override rates, complaints, and downstream outcomes. The incident plan should state when to restrict, roll back, notify, investigate, and reassess the system.
Use one governance cadence across product and risk
The eight artifacts should be produced through existing discovery, architecture, security, procurement, release, and incident processes wherever possible. A separate governance lane creates duplicate meetings and late surprises.
Review higher-risk systems at defined intervals and after material changes. Review lower-risk systems by exception and automated monitoring. The objective is not equal paperwork for every use case; it is reliable evidence that the organization understands and controls the AI it operates.
Related service
AI governance and assurance
Kesho helps organizations turn AI principles, risk frameworks, and obligations into controls that product, engineering, risk, and business teams can operate.
Explore the service