https://taxonomy.eticas.ai/risk/monitoring-evaluation-gaps
Maturity: emerging
Lack of ongoing monitoring that renders datasets obsolete and system outputs unreliable, including absence of feedback mechanisms and periodic evaluation.
This subcategory is emerging. It has not yet been validated through established assessment methods.
Also known as: Monitoring, feedback, evaluation
System type: ADM and LLM systems
Lifecycle stages: Post Processing
Status. Each mapping shows what it rests on. Reviewed means a reviewer has confirmed the mapping against the concept’s current definition and the framework edition the taxonomy currently references; when the only confirmation is that of the person who wrote the mapping, it reads Reviewed (author’s confirmation). Outdated means it was reviewed, but the concept’s definition has changed since, so the review has to be repeated. The other statuses mean that no review has been recorded yet. Inherited mappings have been in the taxonomy since before v5.7.0 and are unchanged. They carry no record of who made them or how, and some were checked by hand when the taxonomy first published its mappings. Agent-proposed mappings come from a review carried out by AI agents, which read the framework’s text and the concept’s definition and agreed on the relation; no person has confirmed them yet. Provisional mappings were made without access to the framework’s text. Unreviewed mappings are older mappings whose target or relation was revised in v5.7.0, and any other mapping without a review. Mappings to a superseded edition of a framework are not shown: where the provision continues, they are carried to the current edition. Mappings a review has changed or rejected are not shown.
| Framework | Reference | Status |
|---|---|---|
| EU AI Act (Regulation 2024/1689) | Article 72 — Post-market monitoring by providers and post-market monitoring plan for high-risk AI systems | Unreviewed |
| ISO/IEC 42001:2023 — AI Management System | A.6.2.6 AI system operation and monitoring | Inherited |
| AIUC-1 — AI Underwriting Company Standard | Monitor AI risk categories | Inherited |
| NIST AI Risk Management Framework (AI 100-1) | MANAGE 4.1: Post-deployment AI system monitoring plans are implemented, including mechanisms for capturing and evaluating input from users and other relevant AI actors, appeal and override, decommissioning, incident response, recovery, and change management. | Agent-proposed |
| Framework | Reference | Status |
|---|---|---|
| W3C Data Privacy Vocabulary — AI Extension | Monitor Control | Agent-proposed |
Source: HRA project taxonomy