<-AI Workflows Go to ToC Data Types->

1. Technical Specification 2. Reference Software 3. Conformance Testing 4. Performance Assessment

1. Technical Specifications

Table 1 provides the links to the specifications and the JSON syntax of all AIMs specified by Technical Specification: Object and Scene Description (MPAI-OSD) V1.3. All previously specified MPAI-OSD AI-Modules are superseded by those specified by V1.3 but may still be used by explicitly signaling their version. AI Modules in bold are Composite.

Table 1 – Specifications and JSON syntax of AIMs used by MPAI-OSD V1.3

AIMs Name and Specification JSON AIMs Name and Specification JSON
OSD-3ED 3D Model Event Description X OSD-EVD Event Description X
OSD-3SD 3D Model Scene Description X OSD-LED LiDAR Event Description X
OSD-AED Audio Event Description X OSD-LSD LiDAR Scene Description X
OSD-ASD Audio Scene Description X OSD-OED Offline Map Event Description X
OSD-AVA Audio-Visual Alignment X OSD-OSD Offline Map Scene Description X
OSD-MED Audio-Visual Event Description X OSD-RED RADAR Event Description X
OSD-SDX Audio-Visual Scene Demultiplexing X OSD-RSD RADAR Scene Description X
OSD-MSD Audio-Visual Scene Description X OSD-SCD Scene Description X
OSD-SMX Audio-Visual Scene Multiplexing X OSD-SED Speech Event Description X
OSD-B3D Basic 3D Model Scene Description X OSD-SSD Speech Scene Description X
OSD-BAS Basic Audio Scene Description X OSD-TVS Television Splitting X
OSD-BMD Basic Audio-Visual Scene Description X OSD-UED Ultrasound Event Description X
OSD-BLD Basic LiDAR Scene Description X OSD-USD Ultrasound Scene Description X
OSD-BOD Basic Offline Map Scene Description X OSD-VDI Visual Direction Identification X
OSD-BRD Basic RADAR Scene Description X OSD-VED Visual Event Description X
OSD-BSC Basic Scene Description X OSD-VII Visual Instance Identification X
OSD-BSD Basic Speech Scene Description X OSD-VOE Visual Object Extraction X
OSD-BUD Basic Ultrasound Scene Description X OSD-VOI Visual Object Identification X
OSD-BVD Basic Visual Scene Description X OSD-VOB Visual Object Identification by Body X
OSD-DVI Direct Visual Identification X OSD-VSD Visual Scene Description X

Note that:

  1. All previously specified MPAI-OSD Data Types that are specified by V1.2 are superseded. Use of earlier versions of Data Types is permitted if their version is explicitly signalled.
  2. MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.
  3. MPAI-OSD V1.3 specifies Basic Scene Geometry and Scene Geometry; Basic Scene Descriptors and Scene Descriptors; and Basic Scene Geometry and Scene Geometry, but not their media specific versions because they cab be obtained by referencing their Qualifiers.

2 Conformance testing

A Data instance of a Data Type Conforms with MPAI-OSD V1.2 if the JSON Data validate against the relevant MPAI-OSD V1.2 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if present. MPAI-OSD V1.2 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.2 specification.

Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.

#3. Reference Software

As a rule, MPAI provides Reference Software implementing the AI Modules released with the BSD-3-Clause licence and the following disclaimers:

  1. The purpose of the Reference Software is to provide a working Implementation of an AIM, not a ready-to-use product.
  2. MPAI disclaims the suitability of the Software for any other purposes than those of the MPAI-OSD Standard, and does not guarantee that it offers the best performance and that it is secure.
  3. Users shall verify that they have the right to use any third-party software required by this Reference Software, e.g., by accepting the licences from third-party repositories.

MPAI-OSD V1.3 provides Reference Software Implementation for some AIMs.

4. Performance Assessment

Performance is a multidimensional entity because it can have various connotations. Therefore, the Performance Assessment Specification should provide methods to measure how well an AIW performs its function, using a metric that depends on the nature of the function, such as:

  1. Quality: Performance Assessment measures how well an AIM performs its function, using a metric that depends on the nature of the function, e.g., how well a Visual Change Detection (VCD) AIM can detect the change of a visual scene.
  2. Bias: Performance Assessment measures the preference given by an AIM to certain elements, using a metric that depends on a bias related to certain attributes of the AIM. For instance, a Visual Instance Identification (VII) AIM tends to have a higher correct identification of visual objects that have a certain shape.
  3. Legal compliance: Performance Assessment measures how well an AIM performs its function, using a metric that assesses its accordance with a certain legal standard.
  4. Ethical compliance: the Performance Assessment of an AIM can measure the compliance of an AIM to a target ethical standard.

MPAI-OSD V1.3 provides Performance Assessment methods for some AIMs.

<-AI Workflows Go to ToC Data Types->