Go to MPAI-OSD Data Types

Definition Functional Requirements Syntax Semantics Conformance Testing Performance Assessment

1      Definition

A Data Type including the arrangement of the Multimodal Objects and the Multimodal Sub-Scenes in a scene.

2      Functional Requirements

A Multimodal Scene Geometry instance must include:

  1. The Multimodal Scene Geometry Header
  2. The ID of the Multimodal Scene Geometry.
  3. The ID and the Space-Time information of the Multimodal Objects in the Multimodal Scene.
  4. The ID and the Space-Time information of the Sub-Multimodal Scenes in the Multimodal Scene.

A Multimodal Scene Geometry instance may include:

  1. The ID of a Virtual Space (M-Instance) to which it refers.
  2. The ID of a U-Environment to which it refers.
  3. The Space-Time information of this Multimodal Scene Geometry instance.
  4. Information about this Multimodal Scene Geometry.
  5. Descriptive Metadata.

3      Syntax

https://schemas.mpai.community/OSD/V1.5/data/MultimodalSceneGeometry.json

4      Semantics

Label Description
Header Multimodal Scene Geometry Header – Standard “OSD-MSG-Vx.y”
MInstanceID Identifier of the M-Instance.
UEnvironment Identifier of the U-Environment.
MultimodalSceneGeometryID ID of this Multimodal Scene Geometry instance.
MultimodalSceneGeometryTime Space and Time of Multimodal Scene Geometry.
MultimodalSceneGeometrySpaceTime Space and Time of Multimodal Scene Geometry.
ObjectCount Number of Objects in Multimodal Scene.
MultimodalSceneObjects[] Set of Data related to Multimodal Objects in the Multimodal Scene.
– MultimodalSceneObjectSpaceTime Space and Time of a Multimodal Object in the MultimodalScene.
– MultimodalSceneObjectQualifier Qualifiers of the Multimodal Object in the Multimodal Scene.
SubMultimodalSceneCount Number of Sub-Multimodal Scenes in the Multimodal Scene.
SubMultimodalScenes[] Set of Data related to Multimodal Objects in the Multimodal Scene.
– SubMultimodalSceneSpaceTime Space and Time of Sub-Multimodal Scene in the Multimodal Scene.
DataXMData Information on this Multimodal Scene Geometry instance.
DescrMetadata Descriptive Metadata

5     Conformance Testing

A Data instance Conforms with Multimodal Scene Geometry (OSD-MSG) if:

  1. The Data validates against the Multimodal Scene Geometry’s JSON Schema.
  2. All Data in the  Multimodal Scene Geometry’s JSON Schema
    1. Have the specified type
    2. Validate against their JSON Schemas
    3. Conform with their Data Qualifiers.

6     Performance Assessment