<-AI Modules Go to ToC

1. Technical Specification 2. Conformance Testing 3. Performance Assessment

1. Technical Specifications

Table 1 provides the Data Types specified by Technical Specification: Object Scene Description (MPAI-OSD) V1.3.

Table 1 – Data Types specified by MPAI-OSD V1.3

OSD-3EV 3D Model Event Descriptors X OSD-BBX Bounding Box X
OSD-3DO 3D Model Object X OSD-CRD Coordinates X
OSD-3SD 3D Model Scene Descriptors X OSD-DSG Device Scene Geometry X
OSD-3SG 3D Model Scene Geometry X OSD-EVT Event Descriptors X
OSD-ANN Annotation X OSD-IID Instance Identifier X
OSD-AEV Audio Event Descriptors X OSD-LEV LiDAR Event Descriptors X
OSD-AUO Audio Object X OSD-LIO LiDAR Object X
OSD-ASD Audio Scene Descriptors X OSD-LSD LiDAR Scene Descriptors X
OSD-ASG Audio Scene Geometry X OSD-LSG LiDAR Scene Geometry X
OSD-MEV Audio-Visual Event Descriptors X OSD-LOC Location X
OSD-AVO Audio-Visual Object X OSD-OBJ Object X
OSD-MSD Audio-Visual Scene Descriptors X OSD-OEV Offline Map Event Descriptors X
OSD-MSG Audio-Visual Scene Geometry X OSD-OMO Offline Map Object X
OSD-B3O Basic 3D Model Object X OSD-OSD Offline Map Scene Descriptors X
OSD-B3S Basic 3D Model Scene Descriptors X OSD-OSG Offline Map Scene Geometry X
OSD-B3G Basic 3D Model Scene Geometry X OSD-OOR Orientation X
OSD-BAO Basic Audio Object X OSD-PAT Path X
OSD-BAS Basic Audio Scene Descriptors X OSD-PCE Perceptible Entity X
OSD-BAG Basic Audio Scene Geometry X OSD-OPV Point of View X
OSD-BMO Basic Audio-Visual Object X OSD-OPS Position X
OSD-BMS Basic Audio-Visual Scene Descriptors X OSD-REV RADAR Event Descriptors X
OSD-BMG Basic Audio-Visual Scene Geometry X OSD-RAO RADAR Object X
OSD-BLO Basic LiDAR Object X OSD-RSD RADAR Scene Descriptors X
OSD-BLS Basic LiDAR Scene Descriptors X OSD-RSG RADAR Scene Geometry X
OSD-BLG Basic LiDAR Scene Geometry X OSD-RPP Right Parallelepiped X
OSD-BLC Basic Location X OSD-SCD Scene Descriptors X
OSD-BOB Basic Object X OSD-SCG Scene Geometry X
OSD-BOO Basic Offline Map Object X OSD-SEL Selector X
OSD-BOS Basic Offline Map Scene Descriptors X OSD-SPT Space-Time X
OSD-BOG Basic Offline Map Scene Geometry X OSD-OSA Spatial Attitude X
OSD-BRO Basic RADAR Object X OSD-SEV Speech Event Descriptors X
OSD-BRS Basic RADAR Scene Descriptors X OSD-SPO Speech Object X
OSD-BRG Basic RADAR Scene Geometry X OSD-SSD Speech Scene Descriptors X
OSD-BSD Basic Scene Descriptors X OSD-SSG Speech Scene Geometry X
OSD-BSG Basic Scene Geometry X OSD-TOB Text Object X
OSD-BSO Basic Speech Object X OSD-TIM Time X
OSD-BSS Basic Speech Scene Descriptors X OSD-TRJ Trajectory X
OSD-BSG Basic Speech Scene Geometry X OSD-UEV Ultrasound Event Descriptors X
OSD-BTO Basic Text Object X OSD-USO Ultrasound Object X
OSD-BUO Basic Ultrasound Object X OSD-USD Ultrasound Scene Descriptors X
OSD-BUS Basic Ultrasound Scene Descriptors X OSD-USG Ultrasound Scene Geometry X
OSD-BUG Basic Ultrasound Scene Geometry X OSD-VEV Visual Event Descriptors X
OSD-BVO Basic Visual Object X OSD-VIO Visual Object X
OSD-BVS Basic Visual Scene Descriptors X OSD-VSD Visual Scene Descriptors X
OSD-BVG Basic Visual Scene Geometry X OSD-VSG Visual Scene Geometry X

Note that:

  1. All previously specified MPAI-OSD Data Types that are specified by V1.2 are superseded. Use of earlier versions of Data Types is permitted if their version is explicitly signalled.
  2. MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.
  3. MPAI-OSD V1.3 specifies Basic Object and Object; Basic Scene Descriptors and Scene Descriptors; and Basic Scene Geometry and Scene Geometry, but not their media specific versions because they cab be obtained by referencing their Qualifiers.

2 Conformance testing

A Data instance of a Data Type Conforms with MPAI-OSD V1.2 if the JSON Data validate against the relevant MPAI-OSD V1.2 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if present. MPAI-OSD V1.2 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.2 specification.

Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.

3. Performance Assessment

Performance Assessment provides methods of assessing the performance of an Data instance. Performance may have various connotations, such as:

  1. Quality: Performance Assessment measures the quality of the Data instance using a metric that depends on the nature of the Data, e.g., the accuracy of identification of Visual Sources in a Visual Scene Geometry.
  2. Bias: Performance Assessment measures the disparity of treatment applied to the Data instance using a metric that depends on a bias related to certain attributes of the Data instance. For example, a systematic misidentification of an object.
  3. Legal compliance: Performance Assessment uses an appropriate metric to measure how well the Data instance complies with with a certain legal standard.

Table 1 provides the Data Types specified by MPAI-OSD V1.2. MPAI-OSD AIWs and AIMs also utilise Data Types specified by other MPAI Technical Specifications. The linked list of all MPAI Data Types is available.

<-AI Modules Go to ToC