EU AI Act — High-Risk AI System Technical Documentation

Overview

Draft and validate the technical documentation required for high-risk AI systems under the EU AI Act (Regulation 2024/1689) Annex IV. Covers system description, risk management (Art. 9), data governance (Art. 10), human oversight (Art. 14), accuracy/robustness metrics, and conformity assessment preparation.

Example Conversation

You: We need to complete the Annex IV technical documentation for our high-risk recruitment screening tool. Can you draft the risk management and data governance sections and run the checker?

Agent: I’ll add the risk management system (Art. 9) with identified risks, mitigation and residual risk acceptance, and the data governance section with training/validation data provenance and bias and gap assessment. Then I’ll run annex_iv_documentation_checker on the draft.

Agent: Updated technical-doc-draft.md and ran annex_iv_documentation_checker…

Agent: Check PASS — all nine Annex IV sections are present, residual risk is stated, data governance includes bias/gap assessment, accuracy and robustness metrics are documented, human oversight measures are described, and the conformity assessment pathway (Annex VI) is identified.

What the Tools Validate

The skill includes one extension tool:

annex_iv_documentation_checker checks the technical documentation against EU AI Act Annex IV and key articles:

• Annex IV section coverage (1–9) — General description, elements and development process, monitoring and control, performance metrics, risk management system, lifecycle changes, harmonised standards or solutions, EU declaration of conformity, post-market monitoring.
• Residual risk (Art. 9) — Risk management must include a residual risk statement or acceptance.
• Data governance / bias & gap (Art. 10) — Data governance must address bias and gap assessment for training/validation data.
• Accuracy and robustness — Document must include accuracy and robustness metrics.
• Human oversight (Art. 14) — Human oversight measures must be described.
• Conformity assessment pathway — The chosen procedure (e.g. Annex VI, Annex VII) must be identified.

Output: PASS if all checks are satisfied; otherwise FAIL with a short line per missing element. Run on the draft before conformity assessment; fix gaps and re-run until the check passes.

Output Excerpt

Excerpt from a generated technical doc and sample checker report.

Technical documentation (excerpt):

## 5. Risk management system (Article 9)
Identified risks: [list]. Mitigation: [measures]. Residual risk acceptance: The provider has accepted the residual risks documented in section 5.2 after mitigation; remaining risks are within acceptable levels for the intended purpose and context of use.

## 2(d) Data requirements and governance
Training data: [sources]. Bias and gap assessment: We assessed training and validation data for representativeness and identified gaps in [X]; mitigation [Y].

## Conformity assessment pathway
Conformity assessment is carried out in accordance with Annex VI (internal control procedure).

annex_iv_documentation_checker report (excerpt):

=== EU AI ACT ANNEX IV DOCUMENTATION CHECKER ===
Result: PASS

Document: technical-doc-draft.md
All 9 Annex IV sections detected.
Residual risk statement or acceptance is present.
Data governance includes bias or gap assessment.
Accuracy and/or robustness metrics are present.
Human oversight measures are described.
Conformity assessment pathway is identified.
Technical documentation meets Annex IV and key Art. 9–14 expectations.

Getting Started

Add your source materials to the project workspace (system design, risk analysis, data documentation), then activate the EU AI Act — High-Risk AI System Technical Documentation skill. Use the bundled template assets/template_high_risk_technical_doc.md as a starting point. The agent will guide you through general description, risk management, data governance, human oversight, accuracy/robustness, and running annex_iv_documentation_checker before conformity assessment.