<-AI Modules Go to ToC

1. Technical Specification 2. Conformance Testing 3. Performance Assessment

1. Technical Specifications

Table 1 provides the Data Types specified by Technical Specification: Object Scene Description (MPAI-OSD) V1.4.

Table 1 – Data Types specified by MPAI-OSD V1.4

Type Acronym Name J Acronym Name J
Generic OSD-BOB Basic Object X OSD-OBJ Object X
OSD-BSD Basic Scene Descriptors X OSD-SCD Scene Descriptors X
OSD-BSG Basic Scene Geometry X OSD-SCG Scene Geometry X
OSD-EVT Event Descriptors X
3D Model OSD-B3O Basic 3D Model Object X OSD-3DO 3D Model Object X
OSD-B3D Basic 3D Model Scene Descriptors X OSD-3SD 3D Model Scene Descriptors X
OSD-B3G Basic 3D Model Scene Geometry X OSD-3SG 3D Model Scene Geometry X
OSD-3EV 3D Model Event Descriptors X
Audio OSD-BAO Basic Audio Object X OSD-AUO Audio Object X
OSD-BAS Basic Audio Scene Descriptors X OSD-ASD Audio Scene Descriptors X
OSD-BAG Basic Audio Scene Geometry X OSD-ASG Audio Scene Geometry X
OSD-AEV Audio Event Descriptors X
Audio-Visual OSD-BMO Basic Audio-Visual Object X OSD-AVO Audio-Visual Object X
OSD-BMS Basic Audio-Visual Scene Descriptors X OSD-MSD Audio-Visual Scene Descriptors X
OSD-BMG Basic Audio-Visual Scene Geometry X OSD-MSG Audio-Visual Scene Geometry X
OSD-MEV Audio-Visual Event Descriptors X
LiDAR OSD-BLO Basic LiDAR Object X OSD-LIO LiDAR Object X
OSD-BLS Basic LiDAR Scene Descriptors X OSD-LSD LiDAR Scene Descriptors X
OSD-BLG Basic LiDAR Scene Geometry X OSD-LSG LiDAR Scene Geometry X
OSD-LEV LiDAR Event Descriptors X
Location OSD-BLC Basic Location X OSD-LOC Location X
Offline Map OSD-BOO Basic Offline Map Object X OSD-OMO Offline Map Object X
OSD-BOS Basic Offline Map Scene Descriptors X OSD-OSD Offline Map Scene Descriptors X
OSD-BOG Basic Offline Map Scene Geometry X OSD-OSG Offline Map Scene Geometry X
OSD-OEV Offline Map Event Descriptors X
RADAR OSD-BRO Basic RADAR Object X OSD-RAO RADAR Object X
OSD-BRS Basic RADAR Scene Descriptors X OSD-RSD RADAR Scene Descriptors X
OSD-BRG Basic RADAR Scene Geometry X OSD-RSG RADAR Scene Geometry X
OSD-REV RADAR Event Descriptors X
Speech OSD-BSO Basic Speech Object X OSD-SPO Speech Object X
OSD-BSS Basic Speech Scene Descriptors X OSD-SSD Speech Scene Descriptors X
OSD-BSG Basic Speech Scene Geometry X OSD-SSG Speech Scene Geometry X
OSD-SEV Speech Event Descriptors X
Text OSD-BTO Basic Text Object X OSD-TOB Text Object X
Ultrasound OSD-BUO Basic Ultrasound Object X OSD-USO Ultrasound Object X
OSD-BUS Basic Ultrasound Scene Descriptors X OSD-USD Ultrasound Scene Descriptors X
OSD-BUG Basic Ultrasound Scene Geometry X OSD-USG Ultrasound Scene Geometry X
OSD-UEV Ultrasound Event Descriptors X
Visual OSD-BVO Basic Visual Object X OSD-VIO Visual Object X
OSD-BVD Basic Visual Scene Descriptors X OSD-VSD Visual Scene Descriptors X
OSD-BVG Basic Visual Scene Geometry X OSD-VSG Visual Scene Geometry X
OSD-VEV Visual Event Descriptors X
Others OSD-ANN Annotation X OSD-SDS Audio Source X
OSD-BBX Bounding Box X OSD-CRD Coordinates X
OSD-DSG Device Scene Geometry X OSD-IID Instance Identifier X
OSD-LTS Light Source X OSD-AOC Object Audio Characteristics X
OSD-OOR Orientation X OSD-PAT Path X
OSD-PCE Perceptible Entity X OSD-OPV Point of View X
OSD-OPS Position X OSD-RPP Right Parallelepiped X
OSD-SEL Selector X OSD-SPT Space-Time X
OSD-OSA Spatial Attitude X OSD-TXM Texture Map X
OSD-TIM Time X OSD-TRJ Trajectory X

Note that:

  1. All previously specified MPAI-OSD Data Types that are specified by V1.3 are superseded. Use of earlier versions of Data Types is permitted if their version is explicitly signalled.
  2. MPAI-OSD AIWs and AIMs utilise Data Types specified by other MPAI Technical Specifications.
  3. MPAI-OSD V1.4 specifies Basic Object and Object; Basic Scene Descriptors and Scene Descriptors; and Basic Scene Geometry and Scene Geometry, but not their media specific versions because they cab be obtained by referencing their Qualifiers.

2 Conformance testing

A Data instance of a Data Type Conforms with MPAI-OSD V1.3 if the JSON Data validate against the relevant MPAI-OSD V1.3 JSON Schema and if the Data Conforms with the relevant Data Qualifier, if present. MPAI-OSD V1.3 does not provide method for testing the Conformance of the Semantics of the Data instance to the MPAI-OSD V1.2 specification.

Conformance testing can be performed by a human using a JSON Validator to verify the Conformance of the syntax of JSON Data to the relevant JSON Schema; and, if the Data has a Qualifier, to verify that the syntax of the Data conforms with the relevant values in the Data Qualifier. Alternatively, Conformance testing can be performed by software implementing the steps above.

3. Performance Assessment

Performance Assessment provides methods of assessing the performance of an Data instance. Performance may have various connotations, such as:

  1. Quality: Performance Assessment measures the quality of the Data instance using a metric that depends on the nature of the Data, e.g., the accuracy of identification of Visual Sources in a Visual Scene Geometry.
  2. Bias: Performance Assessment measures the disparity of treatment applied to the Data instance using a metric that depends on a bias related to certain attributes of the Data instance. For example, a systematic misidentification of an object.
  3. Legal compliance: Performance Assessment uses an appropriate metric to measure how well the Data instance complies with with a certain legal standard.

<-AI Modules Go to ToC