# SPC-02 Capability evaluation suite

Domain: SPC Agent Specification & Pre-Deployment Assurance · HI-AAF v1.3 · Public review · https://humanintel.net/standard/spc/spc-02

A capability evaluation suite is executed pre-deployment, with results recorded. Coverage includes functional accuracy on representative tasks, performance on known edge cases, and behavior on out-of-distribution inputs.

The evaluation suite exercises the agent against its specification before any production deployment. Coverage includes functional accuracy on representative tasks, performance on known edge cases, behavior on out-of-distribution inputs, and regression testing against previously discovered failures. Results are recorded and retained for audit.

## Maturity

- L1 Ad hoc: Controls exist informally; documentation is incomplete; no consistent review.
- L2 Documented: Controls are written down; ownership is assigned; review cadence is defined.
- L3 Operated: Controls are followed in practice; evidence is collected; deviations are tracked. Published criterion for SPC-02: Evaluation suite exists and is executed before every deployment; results are recorded with pass/fail criteria; coverage includes edge cases and out-of-distribution inputs; historical results are retained.
- L4 Measured: Control effectiveness is measured against documented thresholds; trends are reported.
- L5 Continuously Improved: Controls evolve based on incident learning; maturity gains are evidenced over time.

## Evidence an assessor asks for

- Evaluation suite exists and is executed before every deployment.
- Results are recorded with pass/fail criteria.
- Coverage includes edge cases and out-of-distribution inputs.
- Historical results are retained.

## Framework mappings

- NIST AI RMF: MAP 3.4, MAP 4.1
- ISO/IEC 42001: A.6.2.3
- SOC 2 (TSC): CC5.2
- EU AI Act: Art. 9(7), Art. 15(1)
- Singapore: MAIGF Testing & Assurance, AI Verify Reproducibility

Mappings are directional: meeting this control evidences but does not by itself satisfy the external requirement.

## Related

- Glossary: Out-of-distribution: https://humanintel.net/standard/glossary#out-of-distribution

## Cite this control

Human Intelligence. HI-AAF v1.3, SPC-02 Capability evaluation suite. Public review edition, July 2026. https://humanintel.net/standard/spc/spc-02