The increasing incorporation of Artificial Intelligence (AI) systems in organisations has led to the extension of the characteristics of the quality model of the ISO/IEC 25010 standard to include those additional aspects that these systems present.
The changes in ISO/IEC 25059 with regard to product quality are the following:
Functional Suitability incorporates the subcharacteristic:
- Functional Adaptability. Degree to which an AI system can accurately acquire information from data, or the result of previous actions, and use that information in future predictions.
For Functional Correctness, ISO/IEC 25059 warns that machine learning methods often do not provide functional correctness in all observed circumstances, so it is necessary to measure correctness and incorrectness carefully.
Interaction Capability incorporates two subcharacteristics:
- User Controllability. Degree to which a user can adequately intervene in the operation of an AI system in an adequate manner.
- Transparency. Degree to which adequate information about the AI system is communicated to stakeholders.
Reliability incorporates the subcharacteristic:
- Robustness. Degree to which an AI system can maintain its level of performance under all circumstances.
Security incorporates the subcharacteristic:
- Intervenability. Degree to which an operator can intervene in the operation of an AI system in a timely manner to avoid damage or danger.