Skip to content
Human Intelligence seal
Human Intelligence
§ I · Domain SPC · Control 2 of 9
Control
SPC-02
Edition
v.1.3
Status
Public review

SPC · Agent Specification & Pre-Deployment Assurance

SPC-02Capability evaluation suite

A capability evaluation suite is executed pre-deployment, with results recorded. Coverage includes functional accuracy on representative tasks, performance on known edge cases, and behavior on out-of-distribution inputs.

The evaluation suite exercises the agent against its specification before any production deployment. Coverage includes functional accuracy on representative tasks, performance on known edge cases, behavior on out-of-distribution inputs, and regression testing against previously discovered failures. Results are recorded and retained for audit.

Table SPC-02.1 · Maturity criteria · v.1.3

L1 to L5 · the lowest level in scope caps the agent
L1Ad hoc

Controls exist informally; documentation is incomplete; no consistent review.

L2Documented

Controls are written down; ownership is assigned; review cadence is defined.

L3Operated

Controls are followed in practice; evidence is collected; deviations are tracked.

Evaluation suite exists and is executed before every deployment; results are recorded with pass/fail criteria; coverage includes edge cases and out-of-distribution inputs; historical results are retained.

L4Measured

Control effectiveness is measured against documented thresholds; trends are reported.

L5Continuously Improved

Controls evolve based on incident learning; maturity gains are evidenced over time.

The v1.3 edition publishes a control-specific criterion at L3 (Operated). The other levels apply the general ladder to this control; see the maturity ladder.

Evidence an assessor asks for

  1. E.1

    Evaluation suite exists and is executed before every deployment.

  2. E.2

    Results are recorded with pass/fail criteria.

  3. E.3

    Coverage includes edge cases and out-of-distribution inputs.

  4. E.4

    Historical results are retained.

Table SPC-02.2 · Framework mappings

5 of 7 frameworks carry a control-level reference
NIST AI RMFMAP 3.4, MAP 4.1NIST AI Risk Management Framework 1.0
ISO/IEC 42001A.6.2.3ISO/IEC 42001:2023 · Artificial intelligence management system
OWASP LLM Top 10·OWASP Top 10 for Large Language Model Applications
SOC 2 (TSC)CC5.2AICPA Trust Services Criteria for SOC 2 Type II
EU AI ActArt. 9(7), Art. 15(1)EU AI Act · Regulation (EU) 2024/1689
MITRE ATLAS·MITRE ATLAS · Adversarial Threat Landscape for AI Systems
SingaporeMAIGF Testing & Assurance, AI Verify ReproducibilitySingapore Model AI Governance Framework / AI Verify / PDPA

Mappings are directional: meeting this control evidences but does not by itself satisfy the external requirement. A middle dot means no control-level reference is published at this edition; see the crosswalk.

Related controls and terms

Cite this control

Human Intelligence. HI-AAF v1.3, SPC-02 Capability evaluation suite. Public review edition, July 2026. https://humanintel.net/standard/spc/spc-02

Edition v.1.3 · July 2026 · Public review · Markdown · PDF

https://humanintel.net/standard/spc/spc-02

Notice

HI-AAF v1.3 is an independent framework published by Human Intelligence. It is not affiliated with NIST, ISO, AICPA, or any government or accreditation body. The framework is offered openly for review during the current draft cycle.