<-AI Workflows Go to ToC Data Types->

1. Technical Specification 2. Reference Software 3. Conformance Testing 4. Performance Assessment

1. Technical Specifications

Table 1 provides the links to the specifications and the JSON syntax of all AIMs specified by Technical Specification: Object and Scene Description (MPAI-OSD) V1.4. All previously specified MPAI-OSD AI-Modules are superseded by those specified by V1.4 but may still be used by explicitly signaling their version. AI Modules in bold are Composite.

Table 1 – Specifications and JSON syntax of AIMs used by MPAI-OSD V1.3

Acron. Name J Acron. Name J Acron. Name J
OSD-BSC Basic Scene Description X OSD-SCD Scene Description X OSD-EVD Event Description X
OSD-B3D Basic 3D Model Scene Description X OSD-3SD 3D Model Scene Description X OSD-3ED 3D Model Event Description X
OSD-BAS Basic Audio Scene Description X OSD-ASD Audio Scene Description X OSD-AED Audio Event Description X
OSD-BMD Basic Audio-Visual Scene Description X OSD-MSD Audio-Visual Scene Description X OSD-MED Audio-Visual Event Description X
OSD-BLD Basic LiDAR Scene Description X OSD-LSD LiDAR Scene Description X OSD-LED LiDAR Event Description X
OSD-BOD Basic Offline Map Scene Description X OSD-OSD Offline Map Scene Description X OSD-OED Offline Map Event Description X
OSD-BRD Basic RADAR Scene Description X OSD-RSD RADAR Scene Description X OSD-RED RADAR Event Description X
OSD-BSD Basic Speech Scene Description X OSD-SSD Speech Scene Description X OSD-SED Speech Event Description X
OSD-BUD Basic Ultrasound Scene Description X OSD-USD Ultrasound Scene Description X OSD-UED Ultrasound Event Description X
OSD-BVD Basic Visual Scene Description X OSD-VSD Visual Scene Description X OSD-VED Visual Event Description X
OSD-AVA Audio-Visual Alignment X OSD-SDX Audio-Visual Scene Demultiplexing X OSD-SMX Audio-Visual Scene Multiplexing X
OSD-DVI Direct Visual Identification X OSD-TVS Television Splitting X OSD-VCD Visual Change Detection X
OSD-VDI Visual Direction Identification X OSD-VII Visual Instance Identification X OSD-VOE Visual Object Extraction X
OSD-VOI Visual Object Identification X OSD-VOB Visual Object Identification by Body X

Note that:

  1. MPAI-OSD Data Types that are specified by V1.3 are superseded by those specified by V1.4. Use of earlier versions of Data Types is permitted if their version is explicitly signaled.
  2. MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.
  3. MPAI-OSD V1.3 specifies Basic Scene Geometry and Scene Geometry; Basic Scene Descriptors and Scene Descriptors; and Basic Scene Geometry and Scene Geometry, but not their media specific versions because they cab be obtained by referencing their Qualifiers.

2 Conformance testing

A Data instance of a Data Type Conforms with MPAI-OSD V1.4 if the JSON Data validate against the relevant MPAI-OSD V1.4 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if present. MPAI-OSD V1.4 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.5 specification.

Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.

#3. Reference Software

As a rule, MPAI provides Reference Software implementing the AI Modules released with the BSD-3-Clause licence and the following disclaimers:

  1. The purpose of the Reference Software is to provide a working Implementation of an AIM, not a ready-to-use product.
  2. MPAI disclaims the suitability of the Software for any other purposes than those of the MPAI-OSD Standard, and does not guarantee that it offers the best performance and that it is secure.
  3. Users shall verify that they have the right to use any third-party software required by this Reference Software, e.g., by accepting the licences from third-party repositories.

MPAI-OSD V1.3 provides Reference Software Implementation for some AIMs.

4. Performance Assessment

Performance is a multidimensional entity because it can have various connotations. Therefore, the Performance Assessment Specification should provide methods to measure how well an AIW performs its function, using a metric that depends on the nature of the function, such as:

  1. Quality: Performance Assessment measures how well an AIM performs its function, using a metric that depends on the nature of the function, e.g., how well a Visual Change Detection (VCD) AIM can detect the change of a visual scene.
  2. Bias: Performance Assessment measures the preference given by an AIM to certain elements, using a metric that depends on a bias related to certain attributes of the AIM. For instance, a Visual Instance Identification (VII) AIM tends to have a higher correct identification of visual objects that have a certain shape.
  3. Legal compliance: Performance Assessment measures how well an AIM performs its function, using a metric that assesses its accordance with a certain legal standard.
  4. Ethical compliance: the Performance Assessment of an AIM can measure the compliance of an AIM to a target ethical standard.

MPAI-OSD V1.3 provides Performance Assessment methods for some AIMs.

<-AI Workflows Go to ToC Data Types->