<-AI Workflows Go to ToC Data Types->
1. Technical Specification | 2. Reference Software | 3. Conformance Testing | 4. Performance Assessment |
1. Technical Specifications
Table 1 provides the links to the specifications and the JSON syntax of all AIMs specified by Technical Specification: Object and Scene Description (MPAI-OSD) V1.3. All previously specified MPAI-OSD AI-Modules are superseded by those specified by V1.3 but may still be used by explicitly signaling their version. AI Modules in bold are Composite.
Table 1 – Specifications and JSON syntax of AIMs used by MPAI-OSD V1.3
Note that:
- All previously specified MPAI-OSD Data Types that are specified by V1.2 are superseded. Use of earlier versions of Data Types is permitted if their version is explicitly signalled.
- MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.
- MPAI-OSD V1.3 specifies Basic Scene Geometry and Scene Geometry; Basic Scene Descriptors and Scene Descriptors; and Basic Scene Geometry and Scene Geometry, but not their media specific versions because they cab be obtained by referencing their Qualifiers.
2 Conformance testing
A Data instance of a Data Type Conforms with MPAI-OSD V1.2 if the JSON Data validate against the relevant MPAI-OSD V1.2 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if present. MPAI-OSD V1.2 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.2 specification.
Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.
#3. Reference Software
As a rule, MPAI provides Reference Software implementing the AI Modules released with the BSD-3-Clause licence and the following disclaimers:
- The purpose of the Reference Software is to provide a working Implementation of an AIM, not a ready-to-use product.
- MPAI disclaims the suitability of the Software for any other purposes than those of the MPAI-OSD Standard, and does not guarantee that it offers the best performance and that it is secure.
- Users shall verify that they have the right to use any third-party software required by this Reference Software, e.g., by accepting the licences from third-party repositories.
MPAI-OSD V1.3 provides Reference Software Implementation for some AIMs.
4. Performance Assessment
Performance is a multidimensional entity because it can have various connotations. Therefore, the Performance Assessment Specification should provide methods to measure how well an AIW performs its function, using a metric that depends on the nature of the function, such as:
- Quality: Performance Assessment measures how well an AIM performs its function, using a metric that depends on the nature of the function, e.g., how well a Visual Change Detection (VCD) AIM can detect the change of a visual scene.
- Bias: Performance Assessment measures the preference given by an AIM to certain elements, using a metric that depends on a bias related to certain attributes of the AIM. For instance, a Visual Instance Identification (VII) AIM tends to have a higher correct identification of visual objects that have a certain shape.
- Legal compliance: Performance Assessment measures how well an AIM performs its function, using a metric that assesses its accordance with a certain legal standard.
- Ethical compliance: the Performance Assessment of an AIM can measure the compliance of an AIM to a target ethical standard.
MPAI-OSD V1.3 provides Performance Assessment methods for some AIMs.