1. Technical Specification | 2. Conformance Testing | 3. Performance Assessment |
1. Technical Specifications
Table 1 provides the Data Types specified by Technical Specification: Object Scene Description (MPAI-OSD) V1.3.
Table 1 – Data Types specified by MPAI-OSD V1.3
MPAI-OSD V1.3 specifies media-independent the Object, Scene, and Geometry Data Types. Table 2 provides the linked list to the Media-specific Basic Objects and Objects; Basic Scene Descriptors and Scene Descriptors; Basic Scene Geometries and Scene Geometries for compatibility with earlier MPAI-OSD Versions. Objects, Scene Descriptors, and Scene Geometries are prefixed by “Full” to distinguish from the “Basic” ones.
Table 2 – Media Specific Object, Scene Descriptor, and Scene Geometry Data Types
Object | Scene Descriptors | Scene Geometry | Event Descriptors | |||||||||||
Basic | Json | Full | Json | Basic | Json | Full | Json | Basic | Json | Full | Json | Json | ||
Media-independent | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
3DModel | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Audio | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Audio-Visual | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
LiDAR | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Offline Map | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
RADAR | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Speech | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Text | Link | X | Link | X | ||||||||||
Ultrasound | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Visual | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X | Link | X |
Note that:
- All previously specified MPAI-OSD Data Types that are specified by V1.2 are superseded. Use of earlier versions of Data Types is permitted if their version is explicitly signalled.
- MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.
- MPAI-OSD V1.3 specifies Basic Object and Object; Basic Scene Descriptors and Scene Descriptors; and Basic Scene Geometry and Scene Geometry, but not their media specific versions because they cab be obtained by referencing their Qualifiers.
2 Conformance testing
A Data instance of a Data Type Conforms with MPAI-OSD V1.2 if the JSON Data validate against the relevant MPAI-OSD V1.2 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if present. MPAI-OSD V1.2 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.2 specification.
Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.
3. Performance Assessment
Performance Assessment provides methods of assessing the performance of an Data instance. Performance may have various connotations, such as:
- Quality: Performance Assessment measures the quality of the Data instance using a metric that depends on the nature of the Data, e.g., the accuracy of identification of Visual Sources in a Visual Scene Geometry.
- Bias: Performance Assessment measures the disparity of treatment applied to the Data instance using a metric that depends on a bias related to certain attributes of the Data instance. For example, a systematic misidentification of an object.
- Legal compliance: Performance Assessment uses an appropriate metric to measure how well the Data instance complies with with a certain legal standard.
Table 1 provides the Data Types specified by MPAI-OSD V1.2. MPAI-OSD AIWs and AIMs also utilise Data Types specified by other MPAI Technical Specifications. The linked list of all MPAI Data Types is available.