<-AI Workflows Go to ToC Data Types->
1. Technical Specification | 2. Conformance Testing | 3. Performance Assessment |
1. Technical Specifications
Table 1 provides the links to the specifications and the JSON syntax of all AIMs specified by Technical Specification: Object and Scene Description (MPAI-OSD) V1.2. All previously specified MPAI-OSD AI-Modules are superseded by those specified by V1.2 but may still be used by explicitly signaling their version. AI Modules in bold are Composite.
Table 1 – Specifications and JSON syntax of AIMs used by MPAI-OSD V1.2
AIMs | Name and Specification | JSON | AIMs | Name and Specification | JSON |
OSD-AVA | Audio-Visual Alignment | X | OSD-VBD | Visual Basic Scene Description | X |
OSD-ABS | Audio-Visual Basic Scene Description | X | OSD-VCD | Visual Change Detection | X |
OSD-AVE | Audio-Visual Event Description | X | OSD-VDI | Visual Direction Identification | X |
OSD-SDX | Audio-Visual Scene Demultiplexing | X | OSD-VII | Visual Instance Identification | X |
OSD-AVS | Audio-Visual Scene Description | X | OSD-VOE | Visual Object Extraction | X |
OSD-SMX | Audio-Visual Scene Multiplexing | X | OSD-VOI | Visual Object Identification | X |
OSD-DVI | Direct Visual Identification | X | OSD-VSD | Visual Scene Description | X |
OSD-TVS | Television Splitting | X |
2. Conformance Testing
An implementation of an AI Module Conforms with this Technical Specification if its input and output Data and/or Data Objects Conform with the Data or Data Objects specified in this Technical Specification. Note that Data Object is defined as the combination of Data of a certain Data Type and its Qualifier.
The Conformance of a Data instance is to be expressed by a sentence like “Data validates against the Data Type Schema”. This means that:
- Any Data Sub-Type is as indicated in the Qualifier.
- The Data Format is indicated by the Qualifier.
- Any File and/or Stream have the Formats indicated by the Qualifier.
- Any Attribute of the Data is of the type or validates against the Schema specified in the Qualifier.
3. Performance Assessment
Performance Assessment provides methods of assessing the performance of an AIM. Performance may have various connotations, such as:
- Quality: Performance Assessment measures how well an AIM performs its function, using a metric that depends on the nature of the function, e.g., how well a Visual Change Detection (VCD) AIM can detect the change of a visual scene.
- Bias: Performance Assessment measures the preference given by an AIM to certain elements, using a metric that depends on a bias related to certain attributes of the AIM. For instance, a Visual Instance Identification (VII) AIM tends to have a higher correct identification of visual objects that have a certain shape.
- Legal compliance: Performance Assessment measures how well an AIM performs its function, using a metric that assesses its accordance with a certain legal standard.