Go to ToC

1. Technical Specification 2. Conformance Testing 3. Performance Assessment

1. Technical Specifications

Table 1 provides the Data Types specified by Technical Specification: Object Scene Description (MPAI-OSD) V1.4. The Table is organised to give first the Data Types for which a “Basic” and a “Full” versions are specified (Generic, 3D Model, Audio, Audio-Visual, LiDAR, Location, Offline Map, RADAR. Speech, Text, Time, Ultrasound, Visual) followed by Data Types that do not have this characteristic.

Table 1 – Data Types specified by MPAI-OSD V1.4

Type Acronym Name J Acronym Name J
Generic OSD-BOB Basic Object X OSD-OBJ Object X
OSD-BSD Basic Scene Descriptors X OSD-SCD Scene Descriptors X
OSD-BSG Basic Scene Geometry X OSD-SCG Scene Geometry X
OSD-EVT Event Descriptors X
3D Model OSD-B3O Basic 3D Model Object X OSD-3DO 3D Model Object X
OSD-B3D Basic 3D Model Scene Descriptors X OSD-3SD 3D Model Scene Descriptors X
OSD-B3G Basic 3D Model Scene Geometry X OSD-3SG 3D Model Scene Geometry X
OSD-3EV 3D Model Event Descriptors X
Audio OSD-BAO Basic Audio Object X OSD-AUO Audio Object X
OSD-BAS Basic Audio Scene Descriptors X OSD-ASD Audio Scene Descriptors X
OSD-BAG Basic Audio Scene Geometry X OSD-ASG Audio Scene Geometry X
OSD-AEV Audio Event Descriptors X
Audio-Visual OSD-BMO Basic Audio-Visual Object X OSD-AVO Audio-Visual Object X
OSD-BMS Basic Audio-Visual Scene Descriptors X OSD-MSD Audio-Visual Scene Descriptors X
OSD-BMG Basic Audio-Visual Scene Geometry X OSD-MSG Audio-Visual Scene Geometry X
OSD-MEV Audio-Visual Event Descriptors X
LiDAR OSD-BLO Basic LiDAR Object X OSD-LIO LiDAR Object X
OSD-BLS Basic LiDAR Scene Descriptors X OSD-LSD LiDAR Scene Descriptors X
OSD-BLG Basic LiDAR Scene Geometry X OSD-LSG LiDAR Scene Geometry X
OSD-LEV LiDAR Event Descriptors X
Location OSD-BLC Basic Location X OSD-LOC Location Object X
Offline Map OSD-BOO Basic Offline Map Object X OSD-OMO Offline Map Object X
OSD-BOS Basic Offline Map Scene Descriptors X OSD-OSD Offline Map Scene Descriptors X
OSD-BOG Basic Offline Map Scene Geometry X OSD-OSG Offline Map Scene Geometry X
OSD-OEV Offline Map Event Descriptors X
RADAR OSD-BRO Basic RADAR Object X OSD-RAO RADAR Object X
OSD-BRS Basic RADAR Scene Descriptors X OSD-RSD RADAR Scene Descriptors X
OSD-BRG Basic RADAR Scene Geometry X OSD-RSG RADAR Scene Geometry X
OSD-REV RADAR Event Descriptors X
Speech OSD-BSO Basic Speech Object X OSD-SPO Speech Object X
OSD-BSS Basic Speech Scene Descriptors X OSD-SSD Speech Scene Descriptors X
OSD-BSG Basic Speech Scene Geometry X OSD-SSG Speech Scene Geometry X
OSD-SEV Speech Event Descriptors X
Text OSD-BTO Basic Text Object X OSD-TXO Text Object X
Time OSD-BTM Basic Time X OSD-TIM Time X
Ultrasound OSD-BUO Basic Ultrasound Object X OSD-USO Ultrasound Object X
OSD-BUS Basic Ultrasound Scene Descriptors X OSD-USD Ultrasound Scene Descriptors X
OSD-BUG Basic Ultrasound Scene Geometry X OSD-USG Ultrasound Scene Geometry X
OSD-UED Ultrasound Event Descriptors X
Visual OSD-BVO Basic Visual Object X OSD-VIO Visual Object X
OSD-BVD Basic Visual Scene Descriptors X OSD-VSD Visual Scene Descriptors X
OSD-BVG Basic Visual Scene Geometry X OSD-VSG Visual Scene Geometry X
OSD-VSG Visual Event Descriptors X
Other OSD-ANN Annotation X OSD-PCE Perceptible Entity X
OSD-AUS Audio Source X OSD-OPV Point of View X
OSD-BBX Bounding Box X OSD-OPS Position X
OSD-CRD Coordinates X OSD-RPP Right Parallelepiped X
OSD-DSG Device Scene Geometry X OSD-SEL Selector X
OSD-IID Instance Identifier X OSD-SPT Space-Time X
OSD-LTS Light Source X OSD-OSA Spatial Attitude X
OSD-OAC Object Audio Characteristics X OSD-TEM Texture Map X
OSD-OOR Orientation X OSD-TRJ Trajectory X
OSD-PAT Path

Note that:

  1. All MPAI-OSD Data Types specified by previous Versions are superseded. Use of earlier versions of Data Types is permitted if their version is explicitly signaled.
  2. MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.

2 Conformance testing

A Data instance of a Data Type Conforms with MPAI-OSD V1.4 if the JSON Data validate against the relevant MPAI-OSD V1.4 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if one is present. MPAI-OSD V1.4 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.3 specification.

Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.

3. Performance Assessment

Performance Assessment provides methods of assessing the performance of an Data instance. Performance may have various connotations, such as:

  1. Quality: Performance Assessment measures the quality of the Data instance using a metric that depends on the nature of the Data, e.g., the accuracy of identification of Visual Sources in a Visual Scene Geometry.
  2. Bias: Performance Assessment measures the disparity of treatment applied to the Data instance using a metric that depends on a bias related to certain attributes of the Data instance. For example, a systematic misidentification of an object.
  3. Legal compliance: Performance Assessment uses an appropriate metric to measure how well the Data instance complies with with a certain legal standard.

Table 1 provides the Data Types specified by MPAI-OSD V1.2. MPAI-OSD AIWs and AIMs also utilise Data Types specified by other MPAI Technical Specifications. The linked list of all MPAI Data Types is available.

Go to ToC